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In the early 1980s I completed a Ph.D. research investigation into linear quadratic 
Gaussian control of large ships in confined waters. For the past 17 years I have 
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Introduction to control 
engineering 


1.1 Historical review 


Throughout history mankind has tried to control the world in which he lives. From 
the earliest days he realized that his puny strength was no match for the creatures 
around him. He could only survive by using his wits and cunning. His major asset 
over all other life forms on earth was his superior intelligence. Stone Age man devised 
tools and weapons from flint, stone and bone and discovered that it was possible to 
train other animals to do his bidding — and so the earliest form of control system was 
conceived. Before long the horse and ox were deployed to undertake a variety of 
tasks, including transport. It took a long time before man learned to replace animals 
with machines. 

Fundamental to any control system is the ability to measure the output of the 
system, and to take corrective action if its value deviates from some desired value. 
This in turn necessitates a sensing device. Man has a number of “in-built” senses 
which from the beginning of time he has used to control his own actions, the actions 
of others, and more recently, the actions of machines. In driving a vehicle for 
example, the most important sense is sight, but hearing and smell can also contribute 
to the driver's actions. 

The first major step in machine design, which in turn heralded the industrial 
revolution, was the development of the steam engine. A problem that faced engineers 
at the time was how to control the speed of rotation of the engine without human 
intervention. Of the various methods attempted, the most successful was the use of 
a conical pendulum, whose angle of inclination was a function (but not a linear 
function) of the angular velocity of the shaft. This principle was employed by James 
Watt in 1769 in his design of a flyball, or centrifugal speed governor. Thus possibly 
the first system for the automatic control of a machine was born. 

The principle of operation of the Watt governor is shown in Figure 1.1, where 
change in shaft speed will result in a different conical angle of the flyballs. This in 
turn results in linear motion of the sleeve which adjusts the steam mass flow-rate to 
the engine by means of a valve. 

Watt was a practical engineer and did not have much time for theoretical analysis. 
He did, however, observe that under certain conditions the engine appeared to hunt, 
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Flyballs 


Steam 


Fig. 1.1 TheWatt centrifugal speed governor. 


where the speed output oscillated about its desired value. The elimination of hunting, 
or as it is more commonly known, instability, is an important feature in the design of 
all control systems. 

In his paper “'On Governors”, Maxwell (1868) developed the differential equations 
for a governor, linearized about an equilibrium point, and demonstrated that stabil- 
ity of the system depended upon the roots of a characteristic equation having 
negative real parts. The problem of identifying stability criteria for linear systems 
was studied by Hurwitz (1875) and Routh (1905). This was extended to consider the 
stability of nonlinear systems by a Russian mathematician Lyapunov (1893). The 
essential mathematical framework for theoretical analysis was developed by Laplace 
(1749-1827) and Fourier (1758-1830). 

Work on feedback amplifier design at Bell Telephone Laboratories in the 1930s was 
based on the concept of frequency response and backed by the mathematics of complex 
variables. This was discussed by Nyquist (1932) in his paper “Regeneration Theory”, 
which described how to determine system stability using frequency domain methods. 
This was extended by Bode (1945) and Nichols during the next 15 years to give birth to 
what is still one of the most commonly used control system design methodologies. 

Another important approach to control system design was developed by Evans 
(1948). Based on the work of Maxwell and Routh, Evans, in his Root Locus method, 
designed rules and techniques that allowed the roots of the characteristic equation to 
be displayed in a graphical manner. 
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The advent of digital computers in the 1950s gave rise to the state-space formula- 
tion of differential equations, which, using vector matrix notation, lends itself readily 
to machine computation. The idea of optimum design was first mooted by Wiener 
(1949). The method of dynamic programming was developed by Bellman (1957), at 
about the same time as the maximum principle was discussed by Pontryagin (1962). 
At the first conference of the International Federation of Automatic Control 
(IFAC), Kalman (1960) introduced the dual concept of controllability and observ- 
ability. At the same time Kalman demonstrated that when the system dynamic 
equations are linear and the performance criterion is quadratic (LQ control), then 
the mathematical problem has an explicit solution which provides an optimal control 
law. Also Kalman and Bucy (1961) developed the idea of an optimal filter (Kalman 
filter) which, when combined with an optimal controller, produced linear-quadratic- 
Gaussian (LOG) control. 

The 1980s saw great advances in control theory for the robust design of systems 
with uncertainties in their dynamic characteristics. The work of Athans (1971), 
Safanov (1980), Chiang (1988), Grimble (1988) and others demonstrated how uncer- 
talnty can be modelled and the concept of the Hoo norm and ¡:-synthesis theory. 

The 1990s has introduced to the control community the concept of intelligent 
control systems. An intelligent machine according to Rzevski (1995) is one that is 
able to achieve a goal or sustained behaviour under conditions of uncertainty. 
Intelligent control theory owes much of its roots to ideas laid down in the field of 
Artificial Intelligence (Al). Artificial Neural Networks (ANNSs) are composed of 
many simple computing elements operating in parallel in an attempt to emulate their 
biological counterparts. The theory is based on work undertaken by Hebb (1949), 
Rosenblatt (1961), Kohonen (1987), Widrow-Hoff (1960) and others. The concept of 
fuzzy logic was introduced by Zadeh (1965). This new logic was developed to allow 
computers to model human vagueness. Fuzzy logic controllers, whilst lacking the 
formal rigorous design methodology of other techniques, offer robust control with- 
out the need to model the dynamic behaviour of the system. Workers in the field 
include Mamdani (1976), Sugeno (1985) Sutton (1991) and Tong (1978). 


1.2 Control system fundamentals 


1.2.1 Concept of a system 


Before discussing the structure of a control system it is necessary to define what 1s 
meant by a system. Systems mean different things to different people and can include 
purely physical systems such as the machine table of a Computer Numerically 
Controlled (CNC) machine tool or alternatively the procedures necessary for the 
purchase of raw materials together with the control of inventory in a Material 
Requirements Planning (MRP) system. 

However, all systems have certain things in common. They all, for example, 
require inputs and outputs to be specified. In the case of the CNC machine tool 
machine table, the input might be the power to the drive motor, and the outputs 
might be the position, velocity and acceleration of the table. For the MRP system 
inputs would include sales orders and sales forecasts (incorporated in a master 
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Fig. 1.2 The concept ofa system. 


production schedule), a bill of materials for component parts and subassemblies, 
inventory records and information relating to capacity requirements planning. Mate- 
rial requirements planning systems generate various output reports that are used in 
planning and managing factory operations. These include order releases, inventory 
status, overdue orders and inventory forecasts. It is necessary to clearly define the 
boundary of a system, together with the inputs and outputs that cross that boundary. 
In general, a system may be defined as a collection of matter, parts, components or 
procedures which are included within some specified boundary as shown in Figure 
1.2. A system may have any number of inputs and outputs. 

In control engineering, the way in which the system outputs respond in changes to 
the system inputs (i.e. the system response) is very important. The control system 
design engineer will attempt to evaluate the system response by determining a 
mathematical model for the system. Knowledge of the system inputs, together with 
the mathematical model, will allow the system outputs to be calculated. 

It is conventional to refer to the system being controlled as the plant, and this, as 
with other elements, is represented by a block diagram. Some inputs, the engineer will 
have direct control over, and can be used to control the plant outputs. These are 
known as control inputs. There are other inputs over which the engineer has no 
control, and these will tend to deflect the plant outputs from their desired values. 
These are called disturbance inputs. 

In the case of the ship shown in Figure 1.3, the rudder and engines are the control 
inputs, whose values can be adjusted to control certain outputs, for example heading 
and forward velocity. The wind, waves and current are disturbance inputs and will 
induce errors in the outputs (called controlled variables) of position, heading and 
forward velocity. In addition, the disturbances will introduce increased ship motion 
(roll, pitch and heave) which again is not desirable. 


Rudder”———_—_———> ae 

, Position 
Engines ————————> y F d Velocit 
e Ship ae elocity 
Waves '-»>5>————> e q 

Ship Motion 
—__— > ¡ 

Current (roll, pitch, heave) 


Fig. 1.3 A ship as a dynamic system. 
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+ Controlled Variable 
—__—————> x —_———> Plant ps O 
Output 


Summing 
Point 


Fig. 1.4 Plant inputs and outputs. 


Generally, the relationship between control input, disturbance input, plant and 
controlled variable is shown in Figure 1.4. 


1.2.2 Open-loop systems 


Figure 1.4 represents an open-loop control system and is used for very simple 
applications. The main problem with open-loop control is that the controlled varl- 
able is sensitive to changes in disturbance inputs. So, for example, if a gas fire 1s 
switched on in a room, and the temperature climbs to 20*C, it will remain at that 
value unless there is a disturbance. This could be caused by leaving a door to the 
room open, for example. Or alternatively by a change in outside temperature. In 
either case, the internal room temperature will change. For the room temperature to 
remain constant, a mechanism is required to vary the energy output from the gas fire. 


1.2.3 Closed-loop systems 


For a room temperature control system, the first requirement is to detect or sense 
changes in room temperature. The second requirement is to control or vary the energy 
output from the gas fire, if the sensed room temperature is different from the desired 
room temperature. In general, a system that is designed to control the output of a 
plant must contain at least one sensor and controller as shown in Figure 1.5. 


Forward Path 


Summing d 
FOIE Error Control Output 
Desired Value Signal Signal Value 
»(%) > Controller > Plant 
Measured Value 
Sensor e 


Feedback Path 


Fig. 1.5 Closed-loop control system. 
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Figure 1.5 shows the generalized schematic block-diagram for a closed-loop, or 
feedback control system. The controller and plant lie along the forward path, and the 
sensor in the feedback path. The measured value of the plant output is compared at 
the summing point with the desired value. The difference, or error is fed to the 
controller which generates a control signal to drive the plant until its output equals 
the desired value. Such an arrangement is sometimes called an error-actuated system. 


1.3 Examples of control systems 


1.3.1 Room temperature control system 


The physical realization of a system to control room temperature is shown in Figure 
1.6. Here the output signal from a temperature sensing device such as a thermocouple 
or a resistance thermometer is compared with the desired temperature. Any differ- 
ence or error causes the controller to send a control signal to the gas solenoid valve 
which produces a linear movement of the valve stem, thus adjusting the flow of gas to 
the burner of the gas fire. The desired temperature is usually obtained from manual 
adjustment of a potentiometer. 


Insulation 
Outside 
Desired - Control Temperature 
Temperature | Potentio- Signal Gas Solenoid Actual 
————>>)| meter bh» > Valve Room 
Controller Temperature 
Measured Gas 
Temperature Gas Fire |—>> Heat 
Flow-rate Heat ——> Loss 
| » Input ' 
¡AN | > Thermometer 
Fig. 1.6 Room temperature control system. 
Outside 
Temperature 
Gas Heat Insula- 
Error Control Flow-rate Loss | ton Actual 
Desired Signal Signal (m'/s) WS Temperature 
Temperature| Potentio-| + _ (V) (V) | Gas Gas _ (0) 
meter 09 > Controller Solenoid bh», Burner —P69 >> Room 
(eC) (V) _ Valve + 
Heat 
Input 
(w) 


Thermometer |« 


Fig. 1.7 Block diagram of room temperature control system. 
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A detailed block diagram is shown in Figure 1.7. The physical values of the signals 
around the control loop are shown in brackets. 

Steady conditions will exist when the actual and desired temperatures are the same, 
and the heat input exactly balances the heat loss through the walls of the building. 

The system can operate in two modes: 


(a) Proportional control: Here the linear movement of the valve stem is proportional to 
the error. This provides a continuous modulation of the heat input to the room 
producing very precise temperature control. This is used for applications where temp- 
erature control, of say better than 1 *C, is required (1.e. hospital operating theatres, 
industrial standards rooms, etc.) where accuracy is more important than cost. 

(b) On—off control: Also called thermostatic or bang-bang control, the gas valve 1s 
either fully open or fully closed, i.e. the heater is either on or off. This form of 
control produces an oscillation of about 2 or 3*C of the actual temperature 
about the desired temperature, but is cheap to implement and is used for low-cost 
applications (1.e. domestic heating systems). 


1.3.2 Aircraft elevator control 


In the early days of flight, control surfaces of aircraft were operated by cables 
connected between the control column and the elevators and ailerons. Modern 
high-speed aircraft require power-assisted devices, or servomechanisms to provide 
the large forces necessary to operate the control surfaces. 

Figure 1.8 shows an elevator control system for a high-speed jet. 

Movement of the control column produces a signal from the input angular sensor 
which is compared with the measured elevator angle by the controller which generates 
a control signal proportional to the error. This is fed to an electrohydraulic servovalve 
which generates a spool-valve movement that is proportional to the control signal, 


Angle Elevator 


Output Angular 
Sensor 


' Control Control/Signal 
Column 


Actual 
Angle 


Controller 


Angular 
Sensor Measured Angle 


Hydraulic Electrohydraulic 
Cylinder Servovalve 


Fig. 1.8 Elevator control system for a high-speed jet. 
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Fluid 
Desired Error Control Flowerate Hydraulic Actual 
Angle Signal Signal (m/s) Force Angle 
N 
(deg) Input (1+_ (V) (v) Soma: iyaresulio (N) (deg) 
———» Angular Controller —» valve [Pl Cviinder | >| Elevator 
Sensor = y!linder 
Output 
Angular [« 
(v) Sensor 


Fig. 1.9 Block diagram of elevator control system. 


thus allowing high-pressure fluid to enter the hydraulic cylinder. The pressure differ- 
ence across the piston provides the actuating force to operate the elevator. 

Hydraulic servomechanisms have a good power/weight ratio, and are ideal for 
applications that require large forces to be produced by small and light devices. 

In practice, a “feel simulator” is attached to the control column to allow the pilot to 
sense the magnitude of the aerodynamic forces acting on the control surfaces, thus 
preventing excess loading of the wings and tail-plane. The block diagram for the 
elevator control system is shown in Figure 1.9. 


1.3.3 Computer Numerically Controlled (CNC) machine tool 


Many systems operate under computer control, and Figure 1.10 shows an example of 
a CNC machine tool control system. 

Information relating to the shape of the work-piece and hence the motion of the 
machine table is stored in a computer program. This is relayed in digital format, in a 
sequential form to the controller and is compared with a digital feedback signal from 
the shaft encoder to generate a digital error signal. This is converted to an analogue 


Computer 
Controller Machine Table Movement 
——> 
Shaft 
Encoder 
Computer 
Program DC-Servomotor pd 
LETAL A] AS ZEIR e 
> El lisad: Screw l 
ini Bearing 
Digital Power 
rn» Controller Amplifier Tachogenerator 


Digital Positional Feedback 


Analogue Velocity Feedback 


Fig. 1.10 Computer numerically controlled machine tool. 
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Digital 


Desired Position _. . Control Actual Actual 
Digital Signal Torque Velocity Position 
Error (V) (Nm) (m/s) (m) 
3% V) DC : 
Computer| + Digital + Power Machine 
Program Controller Amplifier | P] Servo TA Table Integrator 
motor 
Analogue Tacho- 
Velocity Feedback generator 


Digital Positional | Shaft 
Feedback | Encoder 


Fig. 1.11 Block diagram of CNC machine-tool control system. 


control signal which, when amplified, drives a d.c. servomotor. Connected to the 
output shaft of the servomotor (in some cases through a gearbox) is a lead-screw to 
which is attached the machine table, the shaft encoder and a tachogenerator. The 
purpose of this latter device, which produces an analogue signal proportional to 
velocity, is to form an inner, or minor control loop in order to dampen, or stabilize 
the response of the system. 

The block diagram for the CNC machine tool control system is shown in Figure 1.11. 


1.3.4 Ship autopilot control system 


A ship autopilot is designed to maintain a vessel on a set heading while being 
subjected to a series of disturbances such as wind, waves and current as shown in 
Figure 1.3. This method of control is referred to as course-keeping. The autopilot can 
also be used to change course to a new heading, called course-changing. The main 
elements of the autopilot system are shown in Figure 1.12. 

The actual heading is measured by a gyro-compass (or magnetic compass in a 
smaller vessel), and compared with the desired heading, dialled into the autopilot by 
the ship”s master. The autopilot, or controller, computes the demanded rudder angle 
and sends a control signal to the steering gear. The actual rudder angle is monitored 
by a rudder angle sensor and compared with the demanded rudder angle, to form a 
control loop not dissimilar to the elevator control system shown in Figure 1.8. 

The rudder provides a control moment on the hull to drive the actual heading 
towards the desired heading while the wind, waves and current produce moments that 
may help or hinder this action. The block diagram of the system is shown in Figure 1.13. 


Desired Heading Actual rudder-angle 


A Auto-pilot Steering-gear 
Gyro-compass” ==... 


Sensor 


AA, A O: TF] A A A 


: > EE 
MUATRBAdInO yA Demanded rudder-angle 
Measured rudder-angle 


Á 


Fig. 1.12 Ship autopilot control system. 
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Disturbance 


Actual M A 
. Course Demanded Rudder eS Actual 
Desired Rudder Anal (Nm) h 
y Error ngle Heading 
Heading Angle (deg) [Rudder (deg) 
(deg) Potentio- Autopilot | + Steering AS z 
> meter (Controller) Gear aa dic dd 
va 22-—] eristics | 
Rudder Rudder 
Angle Moment 
Sensor (Nm) 
Measured Gyro- a 
Heading (V) Compass 


Fig. 1.13 Block diagram of ship autopilot control system. 


1.4 Summary 


In order to design and implement a control system the following essential generic 
elements are required: 


1 


Knowledge of the desired value: It is necessary to know what it is you are trying to 
control, to what accuracy, and over what range of values. This must be expressed 
in the form of a performance specification. In the physical system this information 
must be converted into a form suitable for the controller to understand (analogue 
or digital signal). 

Knowledge of the output or actual value: This must be measured by a feedback 
sensor, again in a form suitable for the controller to understand. In addition, the 
sensor must have the necessary resolution and dynamic response so that the 
measured value has the accuracy required from the performance specification. 
Knowledge of the controlling device: The controller must be able to accept meas- 
urements of desired and actual values and compute a control signal in a suitable 
form to drive an actuating element. Controllers can be a range of devices, including 
mechanical levers, pneumatic elements, analogue or digital circuits or microcomputers. 
Knowledge of the actuating device: This unit amplifies the control signal and 
provides the “effort” to move the output of the plant towards its desired value. In 
the case of the room temperature control system the actuator is the gas solenoid valve 
and burner, the “effort” being heat input (W). For the ship autopilot system the 
actuator is the steering gear and rudder, the “effort” being turning moment (Nm). 
Knowledge of the plant: Most control strategies require some knowledge of the 
static and dynamic characteristics of the plant. These can be obtained from 
measurements or from the application of fundamental physical laws, or a com- 
bination of both. 


.4.1 Control system design 


With all of this knowledge and information available to the control system designer, 
all that is left is to design the system. The first problem to be encountered is that the 
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Fig. 1.14 Steps in the design of a control system. 
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knowledge of the system will be uncertain and incomplete. In particular, the dynamic 
characteristics of the system may change with time (time-variant) and so a fixed 
control strategy will not work. Due to fuel consumption for example, the mass of an 
airliner can be almost half that of its take-off value at the end of a long haul flight. 

Measurements of the controlled variables will be contaminated with electrical 
noise and disturbance effects. Some sensors will provide accurate and reliable data, 
others, because of difficulties in measuring the output variable may produce highly 
random and almost irrelevant information. 

However, there is a standard methodology that can be applied to the design of 
most control systems. The steps in this methodology are shown in Figure 1.14. 

The design of a control system is a mixture of technique and experience. This book 
explains some tried and tested, and some more recent approaches, techniques and 
methods available to the control system designer. Experience, however, only comes 
with time. 


System modelling 


2.1 Mathematical models 


If the dynamic behaviour of a physical system can be represented by an equation, or 
a set of equations, this is referred to as the mathematical model of the system. Such 
models can be constructed from knowledge of the physical characteristics of the 
system, 1.e. mass for a mechanical system or resistance for an electrical system. 
Alternatively, a mathematical model may be determined by experimentation, by 
measuring how the system output responds to known inputs. 


2.2 Simple mathematical model of a motor vehicle 


Assume that a mathematical model for a motor vehicle is required, relating the accel- 
erator pedal angle 0 to the forward speed u, a simple mathematical model might be 


u(t) = ab(t) (Q.1) 


Since u and 0 are functions of time, they are written u(t) and 0(t). The constant a 
could be calculated if the following vehicle data for engine torque T, wheel traction 
force F, aerodynamic drag D were available 


T=b00) (2.2) 
F=cT (2.3) 
D=dult) 2.4) 


Now aerodynamic drag D must equal traction force F 


D=F 
du(t) = cT 
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Forward 


Accelerator angle 0(t) (degrees) 
Fig. 2.1 Vehicle forward speed plotted against accelerator angle. 


from (2.2) 
du(t) = cb0(t) 
glving 
u(t) = (5) 0) Q.5) 


Hence the constant for the vehicle is 


a= (2) Q.6) 


If the constants b, c and d were not available, then the vehicle model could be 
obtained by measuring the forward speed u(t) for a number of different accelerator 
angles 0(£) and plotting the results, as shown in Figure 2.1. 

Since Figure 2.1 shows a linear relationship, the value of the vehicle constant a is 
the slope of the line. 


2.3 More complex mathematical models 


Equation (2.1) for the motor vehicle implies that when there is a change in accelerator 
angle, there is an instantaneous change in vehicle forward speed. As all car drivers 
know, it takes time to build up to the new forward speed, so to model the dynamic 
characteristics of the vehicle accurately, this needs to be taken into account. 

Mathematical models that represent the dynamic behaviour of physical systems 
are constructed using differential equations. A more accurate representation of the 
motor vehicle would be 


e + fu= g0(1) (2.7) 


Here, du/dt is the acceleration of the vehicle. When it travels at constant velocity, this 
term becomes zero. So then 


System modelling 


Jul) = go(t) 
u(t) = (7) 00 (2) 


Hence (g/f) is again the vehicle constant, or parameter a in equation (2.1) 


2.3.1 Differential equations with constant coefficients 


In general, consider a system whose output is x(1), whose input is y(t) and contains 
constant coefficients of values a, b, c,..., z. If the dynamics of the system produce a 
first-order differential equation, it would be represented as 


dx 


de 


+ bx = cy(t) Q.9) 
If the system dynamics produced a second-order differential equation, it would be 
represented by 

d?x dx 

—>+b=— = ey(t 2.1 

aaa ey(t) (2.10) 
If the dynamics produce a third-order differential equation, its representation 
would be 
dix dex dx 


aa +04 Fea +ex =fy(1) Q.11) 


Equations (2.9), (2.10) and (2.11) are linear differential equations with constant 
coefficients. Note that the order of the differential equation is the order of the highest 
derivative. Systems described by such equations are called linear systems of the same 
order as the differential equation. For example, equation (2.9) describes a first-order 
linear system, equation (2.10) a second-order linear system and equation (2.11) a 
third-order linear system. 


2.4 Mathematical models of mechanical systems 


Mechanical systems are usually considered to comprise of the linear lumped para- 
meter elements of stiffness, damping and mass. 


2.4.1 Stiffness in mechanical systems 


An elastic element is assumed to produce an extension proportional to the force (or 
torque) applied to it. 
For the translational spring 


Force x Extension 
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A: AAA E 
_—_/VYOO_ LY T(0) 
P(0 P(0) T(0) 
(a) Translational Spring (b) Rotational Spring 
Fig. 2.2 Linear elastic elements. 
Tf xi(0) > xo(), then 
P() = K(xi(1) — xo(0) (2.12) 
And for the rotational spring 
Torque x Twist 
If 6;(+) > 00(1), then 
T(0) = K(0(0) — 000) (2.13) 


Note that K, the spring stiffness, has units of (N/m) in equation (2.12) and (Nm/rad) 
in equation (2.13). 


2.4.2 Damping in mechanical systems 


A damping element (sometimes called a dashpot) is assumed to produce a velocity 
proportional to the force (or torque) applied to it. 
For the translational damper 


Force xx Velocity 


P(0) = Cv(t) = cha 2.14) 
And for the rotational damper 
Torque «xx Angular velocity 
dd, 
T(0) = Cut) = C (Q.15) 


dí 


E P(O 
y 
— 5 10 PE 
(a) Translational Damper (b) Rotational Damper 


Fig. 2.3 Linear damping elements. 
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Note that C, the damping coefficient, has units of (Ns/m) in equation (2.14) and 
(Nm s/rad) in equation (2.15). 


2.4.3 Mass in mechanical systems 


The force to accelerate a body is the product of its mass and acceleration (Newton's 
second law). 
For the translational system 


Force x Acceleration 


O PO mxo (2.16) 
il d: de 
For the rotational system 
Torque «x Angular acceleration 
dis,  ,d%8 
TO =1)=12L= PE (2.17) 


dí de 


In equation (2.17) 7 is the moment of inertia about the rotational axis. 

When analysing mechanical systems, 1t is usual to identify all external forces by 
the use of a “Free-body diagram”, and then apply Newton's second law of motion in 
the form: 


y F =ma for translational systems 
or 
y M =TI[a for rotational systems (Q.18) 


Example 2.1 

Find the differential equation relating the displacements x;(t) and x.(t) for the 
spring-mass-damper system shown in Figure 2.5. What would be the effect of 
neglecting the mass? 


P(0) a ali) a A, yu 


(a) Translational Acceleration (b) Angular Acceleration 


Fig. 2.4 Linear mass elements. 
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C 
K 
— NV] Mm 
Spring | , 
x(0 Damper 
Xol1) 

Fig. 2.5 Spring-mass—damper system. 

dx, 

K(X -X) m > CGP 


y dx E, 


X 
—— Xd A 


Fig. 2.6 Free-body diagram for spring —mass—damper system. 


Solution 


Using equations (2.12) and (2.14) the free-body diagram is shown in Figure 2.6. 


From equation (2.18), the equation of motion is 


dx, dx 
K(x¡ — xo) = C ev =m Er) 
dx. dxo 
Kx; — Kx, =m ar +C Er 
Putting in the form of equation (2.10) 
dx dx 
m Ar +C Ar + Kxo = Kxi(t) 


Hence a spring-mass-damper system is a second-order system. 
If the mass is zero then 
2 


dx, 
K(x¡ — xo) = C er =0 
dx, 
Kxi ES Kxo = e 
Hence 
dxo 
C + Kxo = Kxi(t) 


dí 


Thus if the mass is neglected, the system becomes a first-order system. 


(2.19) 


2.20) 
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Torque T(t) 5 | e | Angular velocity 
pas pe y A a A 
0] D<] 


Fig. 2.7 Flywheel in bearings. 


Example 2.2 

A flywheel of moment of inertia / sits in bearings that produce a frictional moment of 
C times the angular velocity w(t) of the shaft as shown in Figure 2.7. Find the 
differential equation relating the applied torque 7(t) and the angular velocity w(+). 


Solution 
From equation (2.18), the equation of motion is 


SN M=l0 


dw 
T() - Co=12 
+ Cu=T(0) Q21) 


Example 2.3 

Figure 2.8 shows a reduction gearbox being driven by a motor that develops a torque 
Tm(t). It has a gear reduction ratio of 'n* and the moments of inertia on the motor 
and output shafts are [m and 7,, and the respective damping coefficients Cm and Co. 
Find the differential equation relating the motor torque 7 (t) and the output angular 
position 0.(+). 


aand b are the pitch circle radii 
l MA] Cm of the gears. Hence gear reduction 


ratio is n= b/a 


Fig. 2.8 Reduction gearbox. 
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Motor Shaft 


X(t) = Gear tooth Output Shaft 
reaction force 


Fig. 2.9 Free-body diagrams for reduction gearbox. 


Gearbox parameters 
lm =5x 10 kgm? 
l, = 0.01 kg m? 
Cm = 60 x 107 Nms/rad 
Co = 0.15 Nm s/rad 
n= 50:1 


Solution 
The free-body diagrams for the motor shaft and output shaft are shown in Figure 2.9. 
Equations of Motion are 


(1) Motor shaft 


d0m 
Tn(0 — Cm An > ax(t) = Im 


re-arranging the above equation, 


1 0 dOm 
X(0) = a (Taco Le ro Cm a ) (2.22) 
(2) Output shaft 
dm 
AS 
2 
bX(0 Co añ6. L Led 
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re-arranging the above equation, 


1/00 dd. 
X(0)= 5 (1 qe ES q) (2.23) 


Equating equations (2.22) and (2.23) 


b 9. d0m d0s dd. 
a (rato a 2) (2 ón: Se) 


Kinematic relationships 


AO 
a 


dOm no 
de dt 
PO 40, 
de = "agp 
Hence 
d%0, d0, d%0, d0, 
Ti Ln m =1|£ o 
a( Usa de me 3) ( de we e) 
giving the differential equation 
d%9 d0 
2 o 2 o 
(Zo +n Ln) ar + (Es +n Cin) ri nTn(t) (Q.24) 


The terms (1, + nr?) and (C, + 1?Cn) are called the equivalent moment of inertia /, 
and equivalent damping coefficient C. referred to the output shaft. 
Substituting values gives 
lo =(0.01 + 50? x 5 x 107%) = 0.0225 kg m? 
Co = (0.15+ 50? x 60 x 107%) = 0.3 Nms/rad 


From equation (2.24) 


d%0, dd. 
+0.3 


.022 
ie di dí 


= S0Tnm(1) (2.25) 


2.5 Mathematical models of electrical systems 


The basic passive elements of electrical systems are resistance, inductance and capa- 
citance as shown in Figure 2.10. 


21 


22 Advanced Control Engineering 


—> 10) 
(a) Resistance 


vi (1) L vo(1) 
—> (0 


(b) Inductance 


vi (1) y ¡e Vat) 


—=> 10 
(c) Capacitance 


Fig. 2.10 Passive elements of an electrical system. 


For a resistive element, Ohm”s Law can be written 
((0) — va) = Rie) (2.26) 


For an inductive element, the relationship between voltage and current is 
di 
VD —vA0) = Lg, (2.27) 


For a capacitive element, the electrostatic equation is 


0(1) = Clvi(o) — va(0) 
Differentiating both sides with respect to £ 


d d 

E 19) = CEM 120) (2.28) 
Note that if both sides of equation (2.28) are integrated then 

1 
010 — va(0)) = =/ ¡dt (2.29) 

Example 2.4 
Find the differential equation relating v,(1) and va(1) for the RC network shown in 
Figure 2.11. 
Solution 


From equations (2.26) and (2.29) 
»(0) — v(0) = Ri(0) 
2 
v()= =/ idt add 
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va(t) (0) C | va(t) 


Fig. 2.11 RCnetwork. 


or 
CS - 1(t) (Q.31) 
substituting (2.31) into (2.30) 
vi(4) — va(t) = ROoa (2.32) 
Equation (2.32) can be expressed as a first-order differential equation 
ros + Y, = vi(2) (2.33) 


Example 2.5 


Find the differential equations relating v;,(t) and va(t) for the networks shown in 
Figure 2.12. 


R L 
*————— SI . 
70 AS ep vA0 
0) 
(a) 
(0+140 R, Ro 
Y] a 
=—, 
vilo 1,0 Cy AO “1 val) 
MÁ 
(b) 


Fig. 2.12 Electrical networks. 


24 Advanced Control Engineering 


Solution for Network (a) Figure 2.12 
From equations (2.26), (2.27) and (2.29) 


vi¡(0) — va(t) = Ri(0) + a 


i (2.34) 
va(t) = C il idt 
or 
dv. 
Car = (1) (Q.35) 
substituting (2.35) into (2.34) 
q dv, d dv, 
vi(1) — va(1) = RC ES + Lá, (e 2) 
or 
(0) =rc y cn Q.36) 
ds me dí de : 
Equation (2.36) can be expressed as a second-order differential equation 
O TA (2.37) 
de EAT : 
Solution for Network (b) Figure 2.12 
System equations 
v(0) — v3(0) = Ri(t(0) + 2(0)) (2.38) 
1 dv 
n0= 7) ide or OE a00 (2.39) 
v3(0) — va(t) = Ran(1) (2.40) 
1 dv 
10= fade or o = 0 Q.41) 


From equation (2.40) 
v3(1) = Rai(1) + val) 


Substituting for ¿,(t) using equation (2.41) 


d 
AO (2.42) 
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Hence from equations (2.42) and (2.39) 


1 (t) =C; (Rae 10) 


d 
d?v, dv 
=R 2.4 
201025 qe A di (2.43) 
Substituting equations (2.41), (2.42) and (2.43) into equation (2.38) 
o-Ira Y +0 rÍraa E 20 
A ¿Cita art 2d 
which produces the second-order differential equation 
d?y, 
R¡R>C¡C2 553 Ea En (RIC +R¡C2+ RCA v, = vi(t) (2.44) 


2.6 Mathematical models of thermal systems 


It is convenient to consider thermal systems as being analogous to electrical systems 
so that they contain both resistive and capacitive elements. 


2.6.1 Thermal resistance Ry 


Heat flow by conduction is given by Fourier's Law 
KA(01 — 02) 
L 


The parameters in equation (2.45) are shown in Figure 2.13. They are 


Or = (2.45) 


(0, — 0,) = Temperature differential (K) 
A = Normal cross sectional area (m?) 
£ = Thickness (m) 
K = Thermal conductivity (W/mK) 
Or = Heat flow (J/s = W) 


0; Qr 


a 


Fig. 2.13 Heat flow through a flat plate. 
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Equation (2.45) can be written in the same form as Ohm's Law (equation (2.26)) 
(91(1) — 0(1)) = RrQr(i) (2.46) 


where Ry is the thermal resistance and is 


Rr = a (Q.47) 
2.6.2 Thermal capacitance Cy 
The heat stored by a body is 
H(t) = mCj0(t) (2.48) 
where 
H = Heat (J) 
m = Mass (kg) 


Cp = Specific heat at constant 
pressure (J/kg K) 
0 = Temperature rise (K) 
If equation (2.48) is compared with the electrostatic equation 
O(t) = Cv(t) (2.49) 
then the thermal capacitance Cr 1s 
Cr =mC, (Q.50) 


To obtain the heat flow Or, equation (2.48) is differentiated with respect to time 


dHA do 
= — 2.51 
Tr e 
or 
d0 
= Cr— 2.52 
e (2.52) 
Example 2.6 


Heat flows from a heat source at temperature 0,(t) through a wall having ideal 
thermal resistance Rr to a heat sink at temperature 0,(t) having ideal thermal 
capacitance Cr as shown in Figure 2.14. Find the differential equation relating 
9¡(t) and 0(0). 


Solution 
(1) Wall: From equation (2.46) 


_ (010) — 0x0) 


e = 


(2.53) 
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Wall 
na 
A 
A 
A 
Heat 
Source Heat 
0(t) A Sink 0o(t) 
pa 
DA 
Fig. 2.14 Heat transfer system. 
(2) Heat sink: From equation (2.52) 
dO 
Or(0) = Cr, (2.54) 


Equating equations (2.53) and (2.54) 


(01(t) — 00) — C d0, 
Rr Es dí 


Re-arranging to give the first-order differential equation 


do 
RyCr a +0, =01(0) (2.55) 


2.7 Mathematical models of fluid systems 


Like thermal systems, it 18 convenient to consider fluid systems as being analogous to 
electrical systems. There is one important difference however, and this is that the 
relationship between pressure and flow-rate for a liquid under turbulent flow condi- 
tions is nonlinear. In order to represent such systems using linear differential equa- 
tions it becomes necessary to linearize the system equations. 


2.7.1 Linearization of nonlinear functions for small 
perturbations 


Consider a nonlinear function Y = f(x) as shown in Figure 2.15. Assume that it 1s 
necessary to operate in the vicinity of point a on the curve (the operating point) 
whose co-ordinates are X,, Y ,. 

For the small perturbations AY and AY about the operating point a let 


AX =x 


2.56 
Ss (2.56) 
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If the slope at the operating point 1s 


dY 
dX 


then the approximate linear relationship becomes 
_ dY 
dx 


x (2.57) 


Example 2.7 

The free-body diagram of a ship is shown in Figure 2.16. It has a mass of 15 x 10% kg 
and the propeller produces a thrust of K;,, times the angular velocity n of the propeller, 
K;, having a value of 110 x 10* Ns/rad. The hydrodynamic resistance is given by the 
relationship R = C,V?, where C, has a value of 10,000 Ns?/m?. Determine, using 
small perturbation theory, the linear differential equation relating the forward speed 
v(t) and propeller angular velocity n(+) when the forward speed is 7.5 m/s. 


Solution 
Linearize hydrodynamic resistance equation for an operating speed V, of 7.5m/s. 
R= CEJA 
dR 
Y 
av CV 
dR 
== =2C0,V, 
av, CV, 
=2x 10000 x 7.5 
dR 
dv , == 150000 Ns/m 
Y 
AY 
Y=1x) 
Y, EURRUAA rd  r E Approximate linear 
relationship 
X X 


Fig. 2.15 Linearization of a nonlinear function. 
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Xx v,a, 
4 
m 
T=K,,n 
— «—— 
R=C,V? 
Fig. 2.16 Free-body diagram of ship. 
Hence the linear relationship is 
R=Cy (2.58) 
Using Newton's second law of motion 
NY F¿= may 
dv 
T-R=m> 
"a 
dv 
K,, _ —= 3 
n—- Cv=m de 
dv 
m>—+Cyv= K;,n (2.59) 
dí 
Substituting values glves 
d 
(AS x 109) 7, + (150 x 107) = (110 x 100n(1) (2.60) 


Example 2.8 
In Figure 2.17 the tank of water has a cross-sectional area A, and under steady 
conditions both the outflow and inflow is V, and the head is H.,. 


(a) Under these conditions find an expression for the linearized valve resistance Rf 
given that flow through the valve is 


V = AyCay/2gH, 


where 


V = volumetric flow-rate (m/s) 
Ay = valve flow area (m?) 
Ca = coefficient of discharge 

g = acceleration due to gravity (m/s?) 
H = head across the valve (m) 
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(b) If the steady value of the head A, is 1.5m, what is the valve resistance Rf when 


Ay =15x 107 m? 
g = 9.81 m/s? 
Ca =0.6 


(c) If the inflow now increases an amount v; producing an increase in head h and an 
increase in outflow va, find the differential equation relating v, and v, when the 
tank cross-sectional area A is 0.75m?. 


Solution 


(a) Flow through the valve is given by 


V = AyCav2gH 


now 
1d O CaQg)” x 0.5H; 1? 
dH v A 
dV g v 
==" A A 
dHl, yCa 2H, h 
The linearized relationship is 
h= Rv, 
hence 
1 2H, 
Ri = 2 
AyCa g 
| V,+ V, 
h INN 
4 AN 
Ha A 
ZA 
R | 


Fig. 2.17 Tank and valve system. 


(2.61) 
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(b) Inserting values gives 


lea 1 2x 15 
'*=15x103x0.6 Y 9.81 


Ry = 61.45 5/m? (2.62) 


(c) Tank (Continuity Equation) 


Inflow — Outflow = 4 o 


dh 
(Va+ V1) =(Va+v2)=A=— 


dí 
dh 
Vv — Y = eE (2.63) 
Valve (Linearized Equation) 
h= Rfv, 
and 
dh dv, 
ÓN E (2.64) 
Substituting equation (2.64) into equation (2.63) 
dy 
V == ARG, 
giving 
dv, 
ARG + vz, = vi(t) (2.65) 
Inserting values gives 
d 
46.092 q = 00) (2.66) 


2.8 Further problems 


Example 2.9 

A solenoid valve is shown in Figure 2.18. The coil has an electrical resistance of 442, 
an inductance of 0.6 H and produces an electromagnetic force F.(t) of K, times the 
current ¡(t). The valve has a mass of 0.125kg and the linear bearings produce 
a resistive force of C times the velocity u(t). The values of K. and C are 0.4N/A 
and 0.25 Ns/m respectively. Develop the differential equations relating the voltage 
v(t) and current i(t) for the electrical circuit, and also for the current ¡(1) and velocity 
u(t) for the mechanical elements. Hence deduce the overall differential equation 
relating the input voltage v(t) to the output velocity u(t). 
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ul RL K 

q Xx fala a Xx 
FO 
« 

NX ST E 37 O IX 
A. C 

(0) 

v(1) 


Fig. 2.18 Solenoid valve. 


Solution 


di 
dí 
du 


dí 


L—+Ri= vt) 


m— + Cu = Koi(t) 
0.075 %% y 965%, = 0.4v(t) 
0157 657 +u=0. 


Example 2.10 

The laser-guided missile shown in Figure 2.19 has a pitch moment of inertia of 
90kgm?. The control fins produce a moment about the pitch mass centre of 
360 Nm per radian of fin angle £(t). The fin positional control system is described 
by the differential equation 


02% + B(t) = ult) 


where u(t) is the control signal. Determine the differential equation relating the 
control signal u(t) and the pitch angle 6(1). 


Solution 


de de 


Fig. 2.19 Laser-guided missile. 
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Fig. 2.20 Torsional spring=mass—damper system. 


Example 2.11 

A torsional spring of stiffness K, a mass of moment of inertia 7 and a fluid damper 
with damping coefficient C are connected together as shown in Figure 2.20. If the 
angular displacement of the free end of the spring is 0¡(1) and the angular displace- 
ment of the mass and damper is 0.(1), find the differential equation relating 0¡(t) and 
0.(t) given that 


I=2.5kgm? 
C = 12.5 Nms/rad 
K = 250 Nm/rad 


Solution 


d?0, dd. 
2.5 Ar de 1008 A 


+ 2500, = 2500,(0) 


Example 2.12 
A field controlled d.c. motor develops a torque T(t) proportional to the field current 
ir(£). The rotating parts have a moment of inertia 7 of 1.5kgm? and a viscous 
damping coefficient C of 0.5 Nms/rad. 

When a current of 1.0A is passed through the field coil, the shaft finally settles 
down to a steady speed w,(t) of 5rad/s. 


(a) Determine the differential equations relating ¿p(+) and w(t). 
(b) What is the value of the coil constant K., and hence what is the torque developed 
by the motor when a current of 0.5A flows through the field coil? 


Solution 


dweo 
(a) I en 


(b) K. =2.5Nm/A. Ty = 1.25 Nm 


+ Cwo = Keir(t) 
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v,(0 dl | va(0 


Fig. 2.21 Passive RCnetwork. 


Oven 


Ql 


Burner 


Fig. 2.22 Drying oven. 


Example 2.13 
Figure 2.21 shows a passive electrical network. Determine the differential equation 


relating v¡(2) and va(1). 


Solution 


R¡C 


dv, R¡ +R) 
ar + ( Re Ja= vi() 


Example 2.14 
A drying oven which is constructed of firebrick walls is heated by an electrically 
operated gas burner as shown in Figure 2.22. The system variables and constants are 
v¡(£) = burner operating voltage (V) 

O¡(t) = heat input to oven (W) 

0o(t) = internal oven temperature (K) 

0s(t) = temperature of surroundings (K) 

K = burner constant = 2000 W/V 
Ry = thermal resistance of walls = 0.5 x 107 min K/J 


Cy = oven thermal capacitance = 1 x 10*J/K 
Find the differential equation relating v;(2), O,(+) and 0s(1). 


Solution 


dd. 


ST 


+0 = vilo) + 0s(1) 


Time domain analysis 


3.1 Introduction 


The manner in which a dynamic system responds to an input, expressed as a function 
of time, is called the time response. The theoretical evaluation of this response is said 
to be undertaken in the time domain, and is referred to as time domain analysis. It is 
possible to compute the time response of a system if the following is known: 


e the nature of the input(s), expressed as a function of time 
e the mathematical model of the system. 


The time response of any system has two components: 


(a) Transient response: This component of the response will (for a stable system) 
decay, usually exponentially, to zero as time increases. It is a function only of the 
system dynamics, and is independent of the input quantity. 

(b) Steady-state response: This is the response of the system after the transient 
component has decayed and is a function of both the system dynamics and the 
input quantity. 


Xolt) 


¡ 
Transient Period | 
11 
1 


Steady-State Error 


Transient 
Error 


Steady-State Period 


Fig. 3.1 Transient and steady-state periods of time response. 
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The total response of the system is always the sum of the transient and steady-state 
components. Figure 3.1 shows the transient and steady-state periods of time 
response. Differences between the input function x;(t) (in this case a ramp function) 
and system response x/(1) are called transient errors during the transient period, and 
steady-state errors during the steady-state period. One of the major objectives of 
control system design is to minimize these errors. 


3.2 Laplace transforms 


In order to compute the time response of a dynamic system, it is necessary to solve 
the differential equations (system mathematical model) for given inputs. There are 
a number of analytical and numerical techniques available to do this, but the one 
favoured by control engineers is the use of the Laplace transform. 

This technique transforms the problem from the time (or £) domain to the Laplace 
(or s) domain. The advantage in doing this is that complex time domain differential 
equations become relatively simple s domain algebraic equations. When a suitable 
solution is arrived at, it is inverse transformed back to the time domain. The process 
is shown in Figure 3.2. 

The Laplace transform of a function of time A(£) is given by the integral 


LI] = / Fe "di =F(s) (3.1) 


where s is a complex variable dv + ju and is called the Laplace operator. 


s Domain F(s) 


Algebraic 
equations 
Laplace 
Transftorm 
de e Inverse e 
MISAS Laplace Z"[KS]=Ft) 
Transform 
Time Domain f(t) 
Differential < 


equations 


Fig. 3.2 The Laplace transform process. 
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3.2.1 Laplace transforms of common functions 


Example 3.1 
F() = 1 (called a unit step function). 


Solution 
From equation (3.1) 


= -0- »] Sil (3.2) 
S S 
Example 3.2 
f0=e 


L 1f(01=F(5) = / e “e dr 


00 
= 0 eU+0 gs 
0 


1 00 
A 1 —(s+a)t 
Es | s+a S ) 


0 
s+a 


=s+a 


Table 3.1 gives further Laplace transforms of common functions (called Laplace 
transform pairs). 


(3.3) 


3.2.2 Properties of the Laplace transform 
(a) Derivatives: The Laplace transform of a time derivative is 


q” 
añ FO) =SF(S) fs! —£ (0357? —... 3.4) 


where (0), f'(0) are the initial conditions, or the values of £(1), d/di f(1) etc. at1=0 
(b) Linearity 


LAO 2401 = Fis) + País) (3.5) 
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Table 3.1 Common Laplace transform pairs 


Time function f(t) Laplace transform Z| f(0] = F(s) 
1 unit impulse ó(1) 1 
2  unitstep 1 l/s 
3 unit ramp / 1/5? 
4 P ¿HO 
gn+l 
1 
5 eu 
(s+ a) 
a 
E 
EE sís+ a) 
; 17) 
7  sinwt REA 
8  CcosWwt 1 _ we 


9 e“sinuwt 


a. 
10  e“(coswt——sin wi) 
w 


(c) Constant multiplication 
Llaf(0] = ar (s) 
(d) Real shift theorem 
L21f04-T]=e BP F(s) fo T>0 


(e) Convolution integral 


/ AMAA=mAr= F(s)Fxs) 


(f) Initial value theorem 
F0)=lim[f(0]= lim [sF(s)] 
(g) Final value theorem 


f(o)= lim [f(9] = lim[sF(s)] 


3.2.3 Inverse transformation 


The inverse transform of a function of s is given by the integral 


o+j 


1 
sO0=2W=37 f. 


o—juw 


FE(sde"ds 


(3.6) 


(3.7) 


(3.8) 


(3.9) 


(3.10) 


(3.11) 
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In practice, inverse transformation is most easily achieved by using partial fractions 
to break down solutions into standard components, and then use tables of Laplace 
transform pairs, as given in Table 3.1. 


3.2.4 Common partial fraction expansions 


(1) Factored roots 
K A B 
==+ 
sís+a) s (s+a) 


(3.12) 


(11) Repeated roots 


IE, 00 MB 
ss+a) s se (s+a) 


(3.13) 


(tii) Second-order real roots (b? > 4ac) 


K Ñ o in BE yy 6 
slast+bs+c) sís+dMs+e) s (s+d) (s+e) 


(iv) Second-order complex roots (b? < 4ac) 


K _A de Bs+C 
slas+bs+c) s ast+bs+c 


Completing the square glves 


Á Bs+C 
s (s+0ar + 


(3.14) 


Note: In (111) and (iv) the coefficient a is usually factored to a unity value. 


3.3 Transfer functions 


A transfer function is the Laplace transform of a differential equation with zero 
initial conditions. It is a very easy way to transform from the time to the s domain, 
and a powerful tool for the control engineer. 


Example 3.3 
Find the Laplace transform of the following differential equation given: 


(a) initial conditions x, = 4, dx,/dt = 3 
(b) zero initial conditions 
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X(s) 


Fig. 3.3 The transfer function approach. 


Solution 
(a) Including initial conditions: Take Laplace transforms (equation (3.4), Table 3.1). 


(s Xo(s) — 4s — 3) + 5 Xo(5) — 4) + 2Xo(5) = . 


*XoAS) + 35X (5) + 2Xo(5) = + 45+3+12 


+ 45? + 1 
(? +35 +2)X,(5) = A 
45? + 155 +5 
(b) Zero initial conditions 
At 1t=0, xo =0, dxo/d:1 =0. 
Take Laplace transforms 
5 
S*Xo(s) + 35Xo(5) + 2Xo(5) = E 
Xo(s) = a (3.16) 


s(s? + 3s + 2) 
Example 3.3(b) is easily solved using transfer functions. Figure 3.3 shows the general 
approach. In Figure 3.3 


e Xi(s) is the Laplace transform of the input function. 

e Xo(s) is the Laplace transform of the output function, or system response. 

e G(s) is the transfer function, 1.e. the Laplace transform of the differential equation 
for zero initial conditions. 


The solution is therefore given by 
Xo(s) = G(s)Xi(s) (3.17) 
Thus, for a general second-order transfer function 


dx, . pH 
“ap dí 


(as? + bs +0)Xo(s) = KXi(s) 


+ CXo = Kxi(t) 


Hence 


K 


ELO Bl 


Xo(s) = ( 
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X(s) K Xo(s) 


2 
as +bs+cC 


Fig. 3.4 General second-order transfer function. 


X(s)=5/8 1 Xo(s) 
—_— > 


s+3s +2 


Fig. 3.5 Example 3.3(b) expressed as a transfer function. 


Comparing equations (3.17) and (3.18), the transfer function G(s) is 


K 


dio as? + bs+c 


(3.19) 


which, using the form shown in Figure 3.3, can be expressed as shown in Figure 3.4. 
Returning to Example 3.3(b), the solution, using the transfer function approach is 
shown in Figure 3.5. From Figure 3.5 
5 


AR ECN PR 


(3.20) 


which is the same as equation (3.16). 


3.4 Common time domain input functions 


3.4.1 The impulse function 


An impulse is a pulse with a width At — 0 as shown in Figure 3.6. The strength of an 
impulse is its area 4, where 


A = height hx At. (3.21) 


The Laplace transform of an impulse function is equal to the area of the function. 
The impulse function whose area is unity is called a unit impulse ó(1). 


3.4.2 The step function 


A step function is described as x¡(1) = B; X¡(s) = B/s for £ > 0 (Figure 3.7). For a unit 
step function x;(t) = 1; X¡(s) = 1/s. This 1s sometimes referred to as a “constant 
position” input. 
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Impulse 


Pulse 


Y 
t 
At 
o 
Fig. 3.6 The impulse function. 
x(0) 
B 


Fig. 3.7 The step function. 


3.4.3 The ramp function 


A ramp function is described as x;(1) = Ot; Xi(s) = 0/5? for £ > 0 (Figure 3.8). For a 
unit ramp function x;(t) = t; X¡(s) = 1/5?. This is sometimes referred to as a “constant 
velocity” input. 


3.4.4 The parabolic function 


A parabolic function is described as x;(t) = K1?; X¡(s) = 2K/5* for £ > 0 (Figure 3.9). 
For a unit parabolic function x;(t) = 1?; X¡(s) = 2/5*. This is sometimes referred to as 
a “constant acceleration” input. 
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x:(t) 


Fig. 3.8 The ramp function. 


Fig. 3.9 The parabolic function. 


3.5 Time domain response of first-order systems 
3.5.1 Standard form 
Consider a first-order differential equation 


dxo 
ZO 4 bx. =cxi(0) (3.22) 


“a 


Take Laplace transforms, zero initial conditions 
asXo(s) + bXo(s) = cX¡(s) 
(as + bIXo(s) = cXi(s) 
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The transfer function is 


Xo C 
G = — (5) == 
(s) Xi (s) as+b 
To obtain the standard form, divide by b 
5% 
Su 1+5s 
which is written 
K 
G(s) = 1+ 7 (3.23) 


Equation (3.23) is the standard form of transfer function for a first-order system, 
where K = steady-state gain constant and T = time constant (seconds). 


3.5.2 Impulse response of first-order systems 


Example 3.4 (See also Appendix 1, examp34.m) 
Find an expression for the response of a first-order system to an impulse function of 
area A. 


Solution 
From Figure 3.10 


AK AK/T 
1+47Ts (s+1/7) 


Xo(s) = (3.24) 


or 


AK 1 


Equation (3.25) is in the form given in Laplace transform pair 5, Table 3.1, so the 
inverse transform becomes 


AK 


Xxo(1) = TT 


ga 


a Zem (3.26) 


The impulse response function, equation (3.26) is shown in Figure 3.11. 


1+Ts 


Fig. 3.10 Impulse response of a first-order system. 
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Fig. 3.11 Response ofa first-order system to an impulse function of area A. 


3.5.3 Step response of first-order systems 


Example 3.5 (See also Appendix 1, examp35.m) 
Find an expression for the response of a first-order system to a step function of 
height B. 


Solution 
From Figure 3.12 


BRO 1/T 


Equation (3.27) is in the form given in Laplace transform pair 6 Table 3.1, so the 
inverse transform becomes 


xo(1) = BK(1 e! ) (3.28) 
If B= 1 (unit step) and K = 1 (unity gain) then 
xo(f) = (1 e 1) (3.29) 


When time t is expressed as a ratio of time constant T, then Table 3.2 and Figure 3.13 
can be constructed. 


Table 3.2 Unit step response of a first-order system 


t/T 0 0.25 0.5 0.75 1 15 2 2.9 3 4 
xol1) 0 0.221 0.393 0,527 0.632 0.770 0.865 0.920 0.950 0.980 
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Xi¡(s)=B/s K Xo(8) 


Fig. 3.12 Step response of a first-order system. 


3.5.4 Experimental determination of system time constant 
using step response 


Method one: The system time constant is the time the system takes to reach 63.2% of 
its final value (see Table 3.2). 


Method two: The system time constant is the intersection of the slope at += 0 with 
the final value line (see Figure 3.13) since 


Xo(1) =1-—e 7 


dx, IN e 

= =0 ( 7)" 17 0 (3.30) 
dxo 1 
oh at1=0 631) 


This also applies to any other tangent, see Figure 3.13. 


1.2 


0.8 


0.4 


0.2 


0 0.5 1 15 2 25 3 3.5 4 4.5 
Number of Time Constants 


Fig. 3.13 Unit step response ofa first-order system. 
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3.5.5 Ramp response of first-order systems 


Example 3.6 
Find an expression for the response of a first-order system to a ramp function of 


slope Q. 

Solution 

From Figure 3.14 

OK OK/T A B C 


IS ID SS 61D) 


(3.32) 


(See partial fraction expansion equation (3.13)). Multiplying both sides by 


sUs+1/T), we get 
OK 1 1 ' 
T = ÁS +5 +B +5 Cs 


Le. £- Ary Eo Br A Cs? (3.33) 
Equating coefficients on both sides of equation (3.33) 
(): 0=A+C (3.34) 
A 
ly. A 
(5): =5 B (3.35) 
0, QE_B 
(5%) : TF (3.36) 
From (3.34) 
C=-—A 
From (3.36) 
B=0Q0K 
Substituting into (3.35) 
A= -—QKT 
Hence from (3.34) 
C=OKT 
X(s)=Q/5 K Xo(S) 
1+7s 


Fig. 3.14 Ramp response ofa first-order system (see also Figure A1.1). 
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xo(t) x (1/7) 
ÉS 


0 1 2 3 4 5 6 7 
Number of Time Constants 


Fig. 3.15 Unit ramp response ofa first-order system. 


Inserting values of 4, B and C into (3.32) 


OKT OK OKT 


Xo(s) = “UD (3.37) 
Inverse transform, and factor out KO 
xo(8) = Ko( Pl 2) (3.38) 
IfO =1 (unit ramp) and K = 1 (unity gain) then 
Xxo(1) =t-T+ To"? (3.39) 


The first term in equation (3.39) represents the input quantity, the second is the 
steady-state error and the third is the transient component. When time £ is expressed 
as a ratio of time constant T, then Table 3.3 and Figure 3.15 can be constructed. In 
Figure 3.15 the distance along the time axis between the input and output, in the 
steady-state, 1s the time constant. 


Table 3.3 Unit ramp response of a first-order system 


T 0 1 2 3 4 5 6 7 
x(0/T 01 2 3 4 5 6 7 
xo(0/T 0 0.368 1.135 205 3.018 4007 5 6 
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3.6 Time domain response of second-order systems 
3.6.1 Standard form 


Consider a second-order differential equation 


dex, dxXo 
CEE + Par + CXo = exi(t) (3.40) 


Take Laplace transforms, zero initial conditions 
asXo(s) + bsXo(s) + cXo(s) = eXi(s) 
(as? + bs + c)Xo(s) = eXi(s) (3.41) 
The transfer function is 


e 
a? +bs+e 


Xo 
6) =3 6) 


To obtain the standard form, divide by c 


G(s) = == 
(5) 22+25+1 
which 1s written as 
K 
G($) = 5 — 3.42 
65) 294 Es +1 20 
This can also be normalized to make the s? coefficient unity, ¡.e. 
K 2 
C0= === (3.43) 


se + 2uns + u? 


Equations (3.42) and (3.43) are the standard forms of transfer functions for a second- 
order system, where K= steady-state gain constant, “w,= undamped natural 
frequency (rad/s) and € = damping ratio. The meaning of the parameters w, and € 
are explained in sections 3.6.4 and 3.6.3. 


3.6.2 Roots of the characteristic equation and their 
relationship to damping in second-order systems 


As discussed in Section 3.1, the transient response of a system is independent of the 
input. Thus for transient response analysis, the system input can be considered to be 
zero, and equation (3.41) can be written as 


(as? + bs + )Xo(s) =0 
If Xo(s) H 0, then 
as?+bs+c=0 (3.44) 
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Table 3.4 Transient behaviour of a second-order system 


Discriminant Roots Transient response type 
b? > 4ac s¡ and s, real Overdamped 
and unequal Transient 
(+ve) Response 
b? = 4ac s¡ and s, real Critically 
and equal Damped Transient 
(ve) Response 
b? < dac 51 and s, complex Underdamped 
conjugate of the Transient 
form: 51,5. =-—0oz+jw Response 


This polynomial in s is called the Characteristic Equation and its roots will determine 
the system transient response. Their values are 


—bx+ V p? — dac 
2a 


Sl, $2 = (3.45) 


The term (b? — 4ac), called the discriminant, may be positive, zero or negative which 
will make the roots real and unequal, real and equal or complex. This gives rise to the 
three different types of transient response described in Table 3.4. 

The transient response of a second-order system is given by the general solution 


Xo(1) = 4e"* + Be” (3.46) 


This gives a step response function of the form shown in Figure 3.16. 


Underdamping (s, and s> complex) 


Critical damping 
(s, and s, real and equal) 


Overdamping 
(s, and s, real and unequal) 


t 


Fig. 3.16 Effect that roots of the characteristic equation have on the damping of a second-order system. 
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3.6.3 Critical damping and damping ratio 


Critical damping 

When the damping coefficient C of a second-order system has its critical value C., the 
system, when disturbed, will reach its steady-state value in the minimum time without 
overshoot. As indicated in Table 3.4, this is when the roots of the Characteristic 
Equation have equal negative real roots. 


Damping ratio € 

The ratio of the damping coefficient C in a second-order system compared with the 
value of the damping coefficient C. required for critical damping is called the 
Damping Ratio ( (Zeta). Hence 


(== (3.47) 


Thus 
(=0 No damping 
(<1 Underdamping 
=1 Critical damping 
(>1 Overdamping 


Example 3.7 
Find the value of the critical damping coefficient C. in terms of K and m for the 
spring-mass—-damper system shown in Figure 3.17. 


LAAELLE 


AO m x40 | 
1 . +ve 


¡a : 


Xolt) 


Lumped Parameter Diagram Free-Body Diagram 


(a) (b) 


Fig. 3.17 Spring-mass—damper system. 


51 


52 Advanced Control Engineering 


Solution 
From Newton's second law 


y Fx = mMXo 
From the free-body diagram 
F(t) — Kxo(t) — Cxo(t) = mxXo(t) (3.48) 
Taking Laplace transforms, zero initial conditions 
F(s) — KXo(s) — CsXo(s) = ms? Xo(s) 
or 
(ms? + Cs + K)Xo(s) = F(s) (3.49) 
Characteristic Equation is 
m*+Cs+K=0 


] C K 
io. 4+4=+2=0 
m om 


and the roots are 


1 ERE 
$1, 2 = E == (5) 4 (3.50) 


2|m 


Ao 
a 2m 
Also, for critical damping 
Cc? 4K 
mom 
C A 4Km? 
m 
glving 
C. = 2v Km (3.51) 


3.6.4 Generalized second-order system response to a unit step 
input 


Consider a second-order system whose steady-state gain is K, undamped natural 
frequency is w, and whose damping ratio is (, where (< 1. For a unit step input, the 
block diagram is as shown in Figure 3.18. From Figure 3.18 

Ku? 


A E 7) (3:92) 


X(s)=1/5 a Ku? A 


2, 
S+2(4,S+Sw 


Fig. 3.18 Step response of a generalized second-order system for € < 1. 


Expanding equation (3.52) using partial fractions 


Bs+C 
(s? + 2G0ps + w?) 


Xo(s) = 
Equating (3.52) and (3.53) and multiply by s(s? + 2Gwps + w%) 


Kw =A(s + 2G0ps +4) + Bs? + Cs 
Equating coefficients 
(%): 0=4+B 
(5): 0=26m4+C 
(5%) : Ku? E WA 
giving 
A=K, B=-K and C= -—2(w,K 


Substituting back into equation (3.53) 


1 s +20 
Xols) = K 
os) E la + 2608 + 2)! 
Completing the square 


la) 
Ss  l(s+(6o)J+u2-— Eu? 


s + 260 


(+0) + (uy T=08)' 


1 
=K 


Time domain analysis 


(3.53) 


(3.54) 


The terms in the brackets [ ) can be written in the standard forms 10 and 9 in 


Table 3.1. 
Term (1) = A z 
(+60) + (wm y/T=0) 
260 1-( 
Term (2) = 
ny 1 e (2 + (0) TAN =2y 
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Inverse transform 


E 0 _ [e (cosa. /1=3) inf 1=E) ) 
wav 1 — 


A (e (la 3) 6.55 


Equation (3.55) can be simplified to give 


xo(t) = K 0 so 0 cos A ?) es 


=>] sin(w /1=0?) al (3.56) 


When (=0 
xo(t) = K[1 — ecos wnt +0] 
= K[l — cos wnt] (3.57) 


From equation (3.57) 1t can be seen that when there is no damping, a step input will 
cause the system to oscillate continuously at w, (rad/s). 


Damped natural frequency Wy4 
From equation (3.56), when 0<C> 1, the frequency of transient oscillation is 


given by 
we = uv 1 — (? (3.58) 


where “wg is called the damped natural frequency. Hence equation (3.56) can be 


written as 
Xo(t) = Al - 0 cost (+3) nc] (3.59) 
e uni ! 
=XK|1l-— me sin (wat +0) (3.60) 
where 
1-2 
tano = S (3.61) 
S 
When ( = 1, the unit step response is 
xo(1) = K[1 — e “(1 + w0)] (3.62) 


and when (> 1, the unit step response from equation (3.46) is given by 


o 1 6 - 2-1) ut 
s0=E | e =)" y 21) 


dE 4 e iy 2-1 Wni 
AN É == , ( ) p (3.63) 


Time domain analysis 


0 
005 115 225 335445 555 665 775 8 85 9 9.5 10 10.5 1111512 12.5 13 13.5 14 14.5 


w,t (rad) 
Fig. 3.19 Unit step response of a second-order system. 


The generalized second-order system response to a unit step input is shown in Figure 
3.19 for the condition K = 1 (see also Appendix 1, sec_ord.m). 


3.7 Step response analysis and performance 
specification 


3.7.1 Step response analysis 


It is possible to identify the mathematical model of an underdamped second-order 
system from its step response function. 

Consider a unity-gain (K = 1) second-order underdamped system responding to 
an input of the form 


xi(1) = B (3.64) 


The resulting output x,(t) would be as shown in Figure 3.20. There are two methods 
for calculating the damping ratio. 


Method (a): Percentage Overshoot of first peak 


%Overshoot = 5 x 100 (3.65) 


Now 
aj = Be “ntr/2) 
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DÁ 
Be" 
B (with reference to final value) 
Y 
Ea 
B 
Ñ t 
le 7/2 >“ T > 
Fig. 3.20 Step response analysis. 
Thus, 
Be Cuntr/2) 
%Overshoot = BO * 100 (3.66) 
Since the frequency of transient oscillation is w4, then, 
27 
7 === 
wa 
27 
zz AS (3.67) 
wnvy 1 -(? 
Substituting (3.67) into (3.66) 
%Overshoot = e 140/24 V1-% x 100 
%Overshoot =e%/VI-O (3.68) 


Method (b): Logarithmic decrement. Consider the ratio of successive peaks a, and a» 
ay = Be tr/2) (3.69) 


a, = Be n(87/2) (3.70) 
Hence 
—Cuwntr/2 
a _ AA ear conar/2) 
4 e-Cun(37/2) 


007 o (3.71) 


Time domain analysis 


Equation (3.71) can only be used if the damping is light and there is more than one 
overshoot. Equation (3.67) can now be employed to calculate the undamped natural 
frequency 

27 


Wn = 3.72 
Ty 1 — (2 ( ) 


3.7.2 Step response performance specification 


The three parameters shown in Figure 3.21 are used to specify performance in the 
time domain. 


(a) Rise time t,: The shortest time to achieve the final or steady-state value, for the 
first time. This can be 100% rise time as shown, or the time taken for example 
from 10% to 90% of the final value, thus allowing for non-overshoot response. 

(b) Overshoot: The relationship between the percentage overshoot and damping 
ratio is given in equation (3.68). For a control system an overshoot of between 
0 and 10% (1 < € > 0.6) 1s generally acceptable. 

(c) Settling time t,: This is the time for the system output to settle down to within a 
tolerance band of the final value, normally between +2 or 5%. 


Using 2% value, from Figure 3.21 


0.02B = Be“ 
Invert 
50 = e4ni 
XD Be" 
e y 27" (with reference to final value) 
a _ Overshoot +2 or 5% of B 
A e 
Settling Time t. 
< - S » 


Fig. 3.21 Step response performance specification. 
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Take natural logs 
In 50 = Cunts 


glving 


= ( a ) In 50 (3.73) 
Cn 

The term (1/(w,) is sometimes called the equivalent time constant 7, for a second- 

order system. Note that ln 50 (2% tolerance) is 3.9, and In20 (5% tolerance) is 3.0. 

Thus the transient period for both first and second-order systems is three times the 

time constant to within a 5% tolerance band, or four times the time constant to 

within a 2% tolerance band, a useful rule-of-thumb. 


3.8 Response of higher-order systems 


Transfer function techniques can be used to calculate the time response of higher- 
order systems. 


Example 3.5 (See also Appendix 1, examp38.m) 

Figure 3.22 shows, in block diagram form, the transfer functions for a resistance 
thermometer and a valve connected together. The input xi(t) is temperature and the 
output x,(t) is valve position. Find an expression for the unit step response function 
when there are zero initial conditions. 


Solution 
From Figure 3.22 


25 
Xo(s) = 74 
ADS NA 25) 319) 
12.5 
Ss +0.5(s? +5 +25) ii 
Á B Cs+D 
Lt al sE . (3.76) 
s  (s+0.5)  (s+0.5 + (4.97) 
Resistance Thermometer Valve 
X (s)=1/8 1 25 Xo(s) 
1+2s d So +5+25 d 


Fig. 3.22 Block diagram representation of a resistance thermometer and valve. 
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Note that the second-order term in equation (3.76) has had the “square” completed 
since its roots are complex (b? < 4ac). Equate equations (3.75) and (3.76) and multi- 
ply both sides by s(s + 0.55? + s + 25). 


12.5 = (5 + 1.55? + 25.55 + 12.54 + (5 + 5? + 255)B 


+ (57 +0.557)C + (5% + 0.55)D q 
Equating coefficients 
(%): 0=A+B+C 
(3): 0=154+B+0.5C+D 
(5): 0=25.54+25B+0.5D 
Y: 125=1254 
Solving the four simultaneous equations 
A=1, B=-—1.01, C=0.01, D=-—0.5 
Substituting back into equation (3.76) gives 
e 1 1.01 0.01s — 0.5 (3.78) 


+ 
s (s+0.5)  (s+0.5 + (4.97) 
Inverse transform 


Xo(t) = 1 — 1.01e7%% — 0,01e7%%(10.16 sin 4.971 — cos 4.971) (3.79) 


Equation (3.79) shows that the third-order transient response contains both first- 
order and second-order elements whose time constants and equivalent time constants 
are 2 seconds, i.e. a transient period of about 8 seconds. The second-order element 
has a predominate negative sine term, and a damped natural frequency of 4.97 rad/s. 
The time response is shown in Figure 3.23. 


Fig. 3.23 Time response of third-order system. 
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3.9 Further problems 


Example 3.9 
A ship has a mass m and a resistance C times the forward velocity u(t). If the thrust 
from the propeller is K times its angular velocity (+), determine: 


(a) The first-order differential equation and hence the transfer function relating U(s) 
and w(s). 


When the vessel has the parameters: m = 18000 x 10*kg, C = 150000 Ns/m, and 
K = 96000 Ns/rad, find, 


(b) the time constant. 

(c) an expression for the time response of the ship when there is a step change of w(t) 
from 0 to 12.5 rad/s. Assume that the vessel is initially at rest. 

(d) What is the forward velocity after 
(1) one minute 
(11) ten minutes. 


Solution 

(a) m(du/dt) + Cu = Ku(t) 
Un. KO 
a TO 


(b) 120 seconds 
(c) ult) Ea 811 _ e70-008331, 
(d) (1) 3.148 m/s 

(ii) 7.946 m/s 


Example 3.10 


(a) Determine the transfer function relating Va(s) and V¡(s) for the passive electrical 
network shown in Figure 3.24. 

(b) When C=2uF and R¡ = R>= 1 MO, determine the steady-state gain K and 
time constant 7. 

(c) Find an expression for the unit step response. 


Ri 


Fig. 3.24 Passive electrical network. 
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Solution 

¡IM R2/R¡ +R) 
(a) Vi (5) 1 + (RIR)C/R¡ + Ra)s 
(b) 0.5 

1.0 seconds 


(0) vo() =0.5(1 —e7*) 


Example 3.11 
Determine the values of w, and € and also expressions for the unit step response for 
the systems represented by the following second-order transfer functions 


E 1 
WU rr 
. Xo 10 
(1) Xi e s2+65+5 
o 1 
(111) X, (s) = PRAT 
Solution 
Go 2.0 


1.0 (Critical damping) 
xo(8) =1-—e (1 +21) 
(ii) 2.236 
1.342 (Overdamped) 
xo(1) = 2 — 2.5e7* + 0.507 
(ii) 1.0 
0.5 (Underdamped) 
xo(£) = 1 e (cos 0.8661 + 0.577 sin 0.8661) 


Example 3.12 

A torsional spring of stiffness K, a mass of moment of inertia 7 and a fluid damper 
with damping coefficient C are connected together as shown in Figure 3.25. The 
angular displacement of the free end of the spring is 6;(t) and the angular displace- 
ment of the mass and damper is 0.(1). 


so Y K 


Fig. 3.25 Torsional system. 
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(a) Develop the transfer function relating 6;(s) and 0.(s). 

(b) If the time relationship for 6¡(t) is given by 0¡(t) = 41 then find an expression for 
the time response of 0.(t). Assume zero initial conditions. What is the steady- 
state error between 0¡(1) and 0,(1)? 


Solution 
00 1 

a s)= 

a rl 

(b) Go(t) = 41 — 0.2 + e725(0.2c05 9.6821 — 0.361 sin 9.6821) 
0.2 radians. 


Example 3.13 
When a unity gain second-order system is subject to a unit step input, its transient 
response contains a first overshoot of 77%, occurring after 32.5 ms has elapsed. Find 


(a) the damped natural frequency 

(b) the damping ratio 

(c) the undamped natural frequency 

(d) the system transfer function 

(e) the time to settle down to within +2% of the final value 


Solution 
(a) 96.66 rad/s 
(b) 0.083 
(c) 96.99 rad/s 
1 


(d) G(s) = 0.106 x 10352 + 1.712 x 1035 + 1 
(e) 0.486 seconds 


Example 3.14 
A system consists of a first-order element linked to a second-order element without 
interaction. The first-order element has a time constant of 5 seconds and a steady- 
state gain constant of 0.2. The second-order element has an undamped natural 
frequency of 4rad/s, a damping ratio of 0.25 and a steady-state gain constant of 
unity. 

If a step input function of 10 units is applied to the system, find an expression for 
the time response. Assume zero initial conditions. 


Solution 


xo(1) =2.0 — 2.0460 02 4 e="(0.046 cos V151 — 0.094 sin VE) 


Closed-loop control 
systems 


4.1 Closed-loop transfer function 


Any system in which the output quantity is monitored and compared with the input, 
any difference being used to actuate the system until the output equals the input is 
called a closed-loop or feedback control system. 

The elements of a closed-loop control system are represented in block diagram 
form using the transfer function approach. The general form of such a system 1s 
shown in Figure 4.1. 

The transfer function relating R(s) and C(s) is termed the closed-loop transfer 
function. 

From Figure 4.1 


Cs) = G(5)E(s) (4.1) 
Bís) = H(s)C(s) (4.2) 
E(s) = R(s) — B(5) (4.3) 


Substituting (4.2) and (4.3) into (4.1) 


C(s) = G(sK—R(s) — H(SC(5)) 
C(s) = G(SR(s) — G(s)H(s)C(s) 
C(S(1 + G(SH(s5) = G(s)R(s) 


C qa G(s) 
R”>— 14+G(s)H(s) 


(4.4) 


The closed-loop transfer function is the forward-path transfer function divided by 
one plus the open-loop transfer function. 
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Forward Path 


Summing 
point Take-off 
Rs) + Els) point C(s) 
» » G(s) . > 
B(s) 


Feedback Path 


Fig. 4.1 Block diagram of a closed-loop control system. R(s) = Laplace transform of reference input r(t); 
C(s) = Laplace transform of controlled output c(t); B(s) = Primary feedback signal, of value H(s)C(s); 
E(s) = Actuating or error signal, of value R(s) — B(s); G(s) = Product of all transfer functions along the 
forward path; H(s) = Product of all transfer functions along the feedback path; G(s)H(s) = Open-loop 
transfer function; ($) = summing point symbol, used to denote algebraic summation; e = Signal take-off 
point; == Direction of information flow. 


4.2 Block diagram reduction 


4.2.1 Control systems with multiple loops 


A control system may have several feedback control loops. For example, with a ship 
autopilot, the rudder-angle control loop is termed the minor loop, whereas the 
heading control loop is referred to as the major loop. When analysing multiple loop 
systems, the minor loops are considered first, until the system is reduced to a single 
overall closed-loop transfer function. 

To reduce complexity, in the following examples the function of s notation (s) used 
for transfer functions is only included in the final solution. 


Example 4.1 
Find the closed-loop transfer function for the system shown in Figure 4.2. 


Solution 
In Figure 4.2, the first minor loop to be considered is G3H3. Using equation (4.4), this 
may be replaced by 


G5 


Gm1 = TEA 


(4.5) 
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First Minor Loop 


Cascade 


I 

R(s) + Ho! 
5 

I 


Fig. 4.2 Multiple loop control system. 


Now Gi 1s multiplied by, or in cascade with Gj. Hence the combined transfer 
function is 


GG5 
o IET 00 


The reduced block diagram is shown in Figure 4.3. 
Following a similar process, the second minor loop Gm2 may be written 


G>,G; 

14+G3H; 
Gm2 = 14 LG 
1+G3H 


Multiplying numerator and denominator by 1 + G3H; 


G2G3 


G = 
e EN G3H3 + G,G3H» 


But Go is in cascade with G¡, hence 


G¡G>G; 
Gi¡Gmo = 4.7 
a E G3H3 + G2G3H) 1) 


Transfer function (4.7) now becomes the complete forward-path transfer function as 
shown in Figure 4.4. 


66 Advanced Control Engineering 


Second Minor Loop 


Cascade 


| 


H ¡é 
Fig. 4.3 First stage of block diagram reduction. 
R(s) + G¡G>2Gz C(s) 
——> » 


1+ G3Hz + G>2G3H» 


H, > 


Fig. 4.4 Second stage of block diagram reduction. 


The complete, or overall closed-loop transfer function can now be evaluated 


G1G263 
C (5) = FORO 
R 


G1G>G3H, 
1 + 14G3H83+G2G3H» 


Multiplying numerator and denominator by 1 + G3H3 + G2G3H» 


G1(s)G2(s)G3(s) 
1 + GS H3(s) + Gr(5)G3(5s) Hs) + G1(s)G2(s)G3(5s)H (5) 


C 
q 0 = 


(4.8) 
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4.2.2 Block diagram manipulation 


There are occasions when there is interaction between the control loops and, for the 
purpose of analysis, 1t becomes necessary to re-arrange the block diagram configur- 
ation. This can be undertaken using Block Diagram Transformation Theorems. 


Table 4.1 Block Diagram Transformation Theorems 


Transformation Equation Block diagram Equivalent block diagram 


. Combining 
blocks in Y=(G¡G>)X Gi Ga G¡G2 
cascade 


. Combining 
blocks in 
parallel; or Y=G¡X+GX 
eliminating a 
forward loop 


. Removing a 
block from Y=G¡X+G>X 
a forward _ 
path 


. Eliminating 
a feedback Y=G¡(X+ G>Y) 
loop 


. Removing a 
block from 
a feedback 
loop 


Y=G(X+GyY) 


. Rearranging 
summing Z=WtXtY 
points 


. Moving a 
summing 
point ahead 
of a block 


. Moving a 
summing 
point 
beyond 
a block 


. Moving a 
take-off 
point ahead 
of a block 


. Moving a 
take-off 
point beyond 
a block 
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Example 4.2 
Moving a summing point ahead of a block. 
Equation Equation 
Z=G6X=Y Z=1X=+(/6)Y IG (4.9) 
Z=GX+Y 


A complete set of Block Diagram Transformation Theorems is given in Table 4.1. 


Example 4.3 
Find the overall closed-loop transfer function for the system shown in Figure 4.6. 


Solution 
Moving the first summing point ahead of G¡, and the final take-off point beyond Ga 
gives the modified block diagram shown in Figure 4.7. The block diagram shown in 
Figure 4.7 is then reduced to the form given in Figure 4.8. The overall closed-loop 
transfer function is then 
G1G2G3Ga 
Cc a (1+0,0,H,X1+63G4H) 
R 


1 4 G1G2G3G4H; 
"(AFINA +G1G6>A1(1+G3G4H») 


Gr(s)G2(s)G3(s)Ga(s) 


= a + MOI) (5$)4 + Gx3(s)G4(s)H2(s)) + GAs)Gs(s)H3(5) (4. 10) 
aa Z 
G G E 


Y 
> 5 . > 
Fig. 4.5 Moving a summing point ahead of a block. 
Beyond 
ES 
* as 


Ga 


H Ha 


Fig. 4.6 Block diagram with interaction. 
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o 
A 
as 

el 


a als) 
SA 6Ga E A O 


H, He 


Fig. 4.7 Modified block diagram with no interaction. 


Hz 
GG 
Gz Ga C( Ss) 


¡¿áAX,— dl 
1+ G3Ga4Ho 


G; Go 
1+G,GH, 


Fig. 4.8 Reduced block diagram. 


4.3 Systems with multiple inputs 


4.3.1 Principle of superposition 


A dynamic system is linear if the Principle of Superposition can be applied. This 
states that “The response y(t) of a linear system due to several inputs x1(%), 
xD... Xn(t), acting simultaneously is equal to the sum of the responses of each 
input acting alone”. 


Example 4.4 
Find the complete output for the system shown in Figure 4.9 when both inputs act 
simultaneously. 


Solution 

The block diagram shown in Figure 4.9 can be reduced and simplified to the form 
given in Figure 4.10. Putting R2(s) = 0 and replacing the summing point by +1 gives 
the block diagram shown in Figure 4.11. In Figure 4.11 note that C!(s) is response to 
Ri(s) acting alone. The closed-loop transfer function is therefore 


I G¡G> 
1+G6>H) 
(s) 


s)= 
G¡G>H; 
Ri 1+ 1+62H> 
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or 


G1(s)G2(s)R1(s) 
LE GANAS) + CUSGADH(S) 


Cs) = (4.11) 


Now if R¡(s) = 0 and the summing point is replaced by —1, then the response C!(s) 
to input Ra(s) acting alone is given by Figure 4.12. The choice as to whether 
the summing point is replaced by +-1 or —1 depends upon the sign at the summing 
point. 

Note that in Figure 4.12 there is a positive feedback loop. Hence the closed-loop 
transfer function relating R»(s) and C's) is 


Ñ EA 

+ 2 

o) -= 
R> 1 — (06H 
14+G>,H) 


Rs) + + C(s) 
5 
Ho 


+ 
H, ¡d 
+ 
Ra(s) 
Fig. 4.9 System with multiple inputs. 
R(s) + G¡G» C(s) 
» 1+ GoHo e » 


H, 


Ra(s) 


Fig. 4.10 Reduced and simplified block diagram. 
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H PO A 


Fig. 4.11 Block diagram for R:(s) acting alone. 


Fig. 4.12 Block diagram for R2(s) acting alone. 


or 
—G1(s)G2(s) H1(s)R2(s) 
1 + Gr(s)B2(s) + Gr(s)G2(s)H1 (5) 


It should be noticed that the denominators for equations (4.11) and (4.12) are 
identical. Using the Principle of Superposition, the complete response is given by 


C(s) = Cs) + Cs) (4.13) 


Cu (s) e 


(4.12) 


or 


(GE1s)GzÁS) Rs) — (G1(s)G As) H 1 (s))R2(5) 


COTO + GASCA 


(4.14) 


4.4 Transfer functions for system elements 


4.4.1 DC servo-motors 


One of the most common devices for actuating a control system is the DC servo- 
motor shown in Figure 4.13, and can operate under either armature or field control. 


(a) Armature control: This arrangement is shown in schematic form in Figure 4.14. 
Now air gap flux d is proportional to if, or 


9 = Kralr (4.15) 
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Armature 
winding 
Ra; La 


(a) Physical Arrangement 


Ri 


er 1) 


3 z 


(b) Schematic Diagram 


Fig. 4.13 Simple DC servo-motor. 


where Kg is the field coil constant. 
Also, torque developed Tn is proportional to the product of the air gap flux and 
the armature current 


Tm(0) == O Kamia(£) (4.16) 
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Ra La 


110) 


alt) 


Fig. 4.14 DC servo-motor under armature control. ea(t) = Armature excitation voltage; ep(t) = Back emf; 
¡,(t) = Armature current; R,= Armature resistance; L,= Armature inductance; €; = Constant field 
voltage; Í£ = Constant field current; Ty = Torque developed by motor; 0(t) = Shaft angular displacement; 
w(t) = Shaft angular velocity = d0/dt. 


where Kam is the armature coil constant. 
Substituting (4.15) into (4.16) gives 


Tn(0 = (KraKamipia(0) (4.17) 
Since if is constant 
Tin (1) = Kaia(0) (4.18) 
where the overall armature constant K., is 
Ka = Kid Kamit (4.19) 


When the armature rotates, 1t behaves like a generator, producing a back emf ep(1) 
proportional to the shaft angular velocity 


ev(1) = Ko o = Kult) (4.20) 


where K; is the back emf constant. 
The potential difference across the armature winding is therefore 


día 
ea(t) — evld) = La ar ER (4.21) 


Taking Laplace transforms of equation (4.21) with zero initial conditions 
Eals) — Evls) = (Las + Ra)als) (4.22) 


Figure 4.15 combines equations (4.18), (4.20) and (4.22) in block diagram form. 
Under steady-state conditions, the torque developed by the DC servo-motor is 


Tnl0)=(ea(0) — Ko) e 
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Eds) + 4 la(s) Ñ Tm(S) 
E: — 
» Ls+R O d 


K Ea 0) 
Fig. 4.15 Block diagram representation of armature controlled DC servo-motor. 
or 
Ka KaK; 
Tm(t) = Calt Wut 4.23 
(0) (7) 10) (E 0 (4.23) 


From equation (4.23), the relationship between Ti(2), w(t) and E,(t) under steady- 
state conditions is shown in Figure 4.16. 

(b) Field control: This arrangement is shown in schematic form in Figure 4.13, 
with the exception that the armature current ¡, is held at a constant value. Equation 
(4.17) may now be written as 


Tm(t) = (Kta KamiaJir(1) (4.24) 
and since /, is a constant, then 
Tin(t) = Krir(t) (4.25) 
where the overall field constant Kf is 
Kt = KtaKamla (4.26) 


In this instance, the back emf ep does not play a part in the torque equation, but it 
can produce difficulties in maintaining a constant armature current la. 
The potential difference across the field coil is 


di 
ent) = a + Reis (4.27) 


Taking Laplace transforms of equation (4.27) with zero initial conditions 


Er(s) = (Les + RyYMr(s) (4.28) 


Figure 4.17 combines equations (4.25) and (4.28) in block diagram form. 
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Increasing €ea(t) 


w(t) (rad/s) 


Fig. 4.16 Steady-state relationship between T(t), w(t) and ex(t) for an armature controlled DC servo- 
motor. 


Tm(S) 


Lis + Ri 


Fig. 4.17 Block diagram representation of field controlled DC servo-motor. 


Under steady-state conditions, the torque developed by the DC servo-motor is 
Kr 
Ta(1) = (deje (4.29) 
f 


The relationship between T¡n(1), er(t) and w(t) under steady-state conditions is shown 
in Figure 4.18. 


4.4.2 Linear hydraulic actuators 


Hydraulic actuators are employed in such areas as the aerospace industry because 
they possess a good power to weight ratio and have a fast response. 

Figure 4.19 shows a spool-valve controlled linear actuator. When the spool-valve 
is moved to the right, pressurized hydraulic oil flows into chamber (1) causing the 
piston to move to the left, and in so doing forces oil in chamber (2) to be expelled to 
the exhaust port. 

The following analysis will be linearized for small perturbations of the spool-valve 
and actuator. 
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Tm(1) Tit) Increasing ej(t) 
(Nm) (Nm) A 


eii) (V) wit) (rad/s) 
(a) (b) 


Fig. 4.18 Steady-state relationship between T.(t), es(t) and w(t) for a field controlled DC servo-motor. 


Fig. 4.19 Spool-valve controlled linear actuator. 


It is assumed that: 


e the supply pressure Ps 1s constant 

e the exhaust pressure P. is atmospheric 

e the actuator is in mid-position so that V, = V, = V, which is half the total volume 
of hydraulic fluid Y, 

the hydraulic oil is compressible 

the piston faces have equal areas 4 

O and O» are the volumetric flow-rates into chamber (1) and out of chamber (2) 
the average, or load flow-rate Oy has a value (O¡ + 0,)/2 

P¡ and P,) are the fluid pressures in chamber (1) and chamber (2) 

the load pressure P| has a value (P¡ — P>) 
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(a) Actuator analysis: The continuity equation for the chambers may be written 


y Dip y Oou: = (rate of change of chamber volume) 
+ (rate of change of oil volume) (4.30) 


In equation (4.30), the rate of change of chamber volume is due to the piston 
movement, 1.e. dV/dt. The rate of change of oil volume is due to compressibility 
effects, 1.e.: 

Bulk Modulus of oil, 4 = Volumetric stress/V olumetric strain 


dP 


P= 77 (4.31) 


Note that in equation (4.31) the denominator is negative since an increase in pressure 
causes a reduction in oil volume. 


Hence 
dy  dP 
1 =p 
Giving, when differentiated with respect to time 
dV VN dP 
IN (5) 7 (4.32) 


For chamber (1), equation (4.30) may be expressed as 


. av VN dP; 
90 + (5) (4.33) 


and for chamber (2) 


: da (Va AP, 
Dr Bo== 2 T (5) Ar (4.34) 
Now 
dad 
 -4t0 
Thus, from egations (4.33) and (4.34) 
so L/dV,  dV, 1 dP dP, 
OL = Ora +3 (, 2) + q 2) (4.35) 


If leakage flow-rate Oleak is laminar, then 


Oteak = CpPL (4.36) 


78 Advanced Control Engineering 


where C; is the leakage coefficient. Also, if V, = V2 = V,, then 
dV, dv,  dV, 


de dt dt Qu9m) 
Hence equation (4.35) can be written 
; dVY, Vid 
OL = CpPL + q + 26d: (P, — P>) (4.38) 
or 
dX. Vi dPL 
OL = CpPL +4 dí 48 di (4.39) 
where 
dv, dXo 
= A 
dí dí 
and 
V, = A 


(b) Linearized spool-valve analysis: Assume that the spool-valve ports are rectan- 
gular in form, and have area 


Ay=WX, (4.40) 
where W is the width of the port. 


From orifice theory 
: pe 
el Cs (4.41) 
: 2 
0) = CaWXyy | -(P> — 0) (4.42) 
P 


whereo Ca is a coefficient of discharge and p is the fluid density. 
Equating (4.41) and (4.42) 


and 


Ps —P¡ =P) (4.43) 
since 

Pi, =P,-P») 
Equation (4.43) may be re-arranged to glve 


 Ps+PL 


P; > 


(4.44) 
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From equations (4.41) and (4.42) the load flow-rate may be written as 


DP =P 
O =CWX, ( a -) (4.45) 


Hence 
O, = F(Xy,PL) (4.46) 


Equation (4.45) can be linearized using the technique described in section 2.7.1. If q, 
xy and p are small perturbations of parameters OL, Xy and P, about some operat- 
ing point “a”, then from equation (4.46) 


. 001 DOL 
1= Gx, Má + op db (4.47) 
or 
dí = Kqxy — Kopi (4.48) 
where 
K¿ (flow gain) = C4Wy Po, — Pa) (4.49) 
P 
and 


(flow-pressure coefficient which has a negative value) 


—=CaWXva |] 1 
K.= 4.50 
2 p(Ps — Pia) ( ) 


Note that P¡, and Xy, are the values of P, and X, at the operating point “a”. 

The relationship between O, PL and X., from equation (4.45), together with the 
linearized relations q, , P and x, are shown in Figure 4.20. 

Equation (4.39) is true for both large and small perturbations, and so can be 
written 


dxXo 
 = Á— A 4.51 
di dr + RF y E (4.51) 


Equating (4.48) and (4.51) gives 


dXo V; dpL 
Ko _—— 4.52 
aC +KPA 4 (4.52) 


K¿Xy = A 


Taking Laplace transforms (zero initial conditions), but retaining the lower-case 
small perturbation notation gives 


K¿Xy(s) = Asxo(s) + (a + XK.) + AS (4.53) 
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Increasing Xy 


Linearized 


Ps PL (Pa) 


Fig. 4.20 Pressure—Flow-rate characteristics for a spool-valve. 


The force to accelerate the mass m is shown in Figure 4.21. From Figure 4.21 


2 E to (4.54) 


AP = MXo 
Take Laplace transforms with zero initial conditions and using lower-case notation 
m 
pL(s) = 2x0 (5) (4.55) 


Inserting equation (4.55) into (4.53) gives 


Kaxv(s) = Asxo(s) y («cs H Ke) y o) E 5) x0(5) (4.56) 


Equation (4.56) may be re-arranged to give the transfer function relating x.(s) and 
Xy(5) 


APL 


y Xo(1), Xo(1), Xo(1) 


Fig. 4.21 Free-body diagram of load on hydraulic actuator. 
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e Ky 
2 (s) = e a (4.57) 
O 
Equation (4.57) can be written in the standard form 
K; 
A a (4.58) 
Ky (E + 2541) 
o nh 
where 
] K 
K (hydraulic gain) = A 
4842 
“¿nh (hydraulic natural frequency) = 8 
mV; 
] ' Ko 4 
Ch (hydraulic damping ratio) = (2 > ) mm + 


Since the Bulk Modulus of hydraulic oil is in the order of 1.4 GPa, if m and V, are 
small, a large hydraulic natural frequency is possible, resulting in a rapid response. 
Note that the hydraulic damping ratio is governed by Cp and K.. To control the level 
of damping, it is sometimes necessary to drill small holes through the piston. 


4.5 Controllers for closed-loop systems 


4.5.1 The generalized control problem 


A generalized closed-loop control system is shown in Figure 4.22. The control 
problem can be stated as: “The control action u(+) will be such that the controlled 
output c(+) will be equal to the reference input r,(t) for all values of time, irrespective 
of the value of the disturbance input ra(1). 

In practice, there will always be transient errors, but the transient period should be 
kept as small as possible. It is usually possible to design the controller so that steady- 
state errors are minimized, or ideally, eliminated. 


Ra(s) 


Disturbance 
Input 


Cs) 
Plant 
Reference Input Control Controlled 
Action Output 


Fig. 4.22 Generalized closed-loop control system. 
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4.5.2 Proportional control 


In this case, the control action, or signal is proportional to the error elt) 
u(t) = Kye(t) (4.59) 
where K; is the proportional gain constant. 


If the plant dynamics are first-order, then Figure 4.22 can be described as shown in 
Figure 4.23. The plant transfer function is 


(U(s) — Roo +) = C(s) (4.60) 


And the proportional control law, from equation (4.59) becomes 
U(s) = K(Ri(s) — C(s)) (4.61) 


Inserting equation (4.61) into equation (4.60) gives 
_ (K1(Ri(s) — Cls)) — Rals)¿K 


Cl 4.62 
(5) (1+T5) iii 
which can be written as 

La +K¡K)+ TsiC(s) = K¡KR¡(s) — KRa(s) (4.63) 

Re-arranging equation (4.63) gives 

K¡K K 
E R)R1(5) Ra(s) 

C(s) = (Ez) (mx) (4.64) 


QU + (5%x)93 
When ri(2) is a unit step, and r»(1) is zero, the final value theorem (equation (3.10)) 
glves the steady-state response 


c(t) = E as t => 00. 
1+K¡|K 


Proportional 
Controller 


CS CI us + 2- C(s) 


Fig. 4.23 Proportional control of a first-order plant. 
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When r2(1) is a unit step, and r;(1) is zero, the final value theorem (equation (3.10)) 
gives the steady-state response 


c(t) E as 1 
= — —_— —> ; 
14 K¡|K dd 


Hence, for the system to have zero steady-state error, the terms in equation (4.64) 


should be 
K¡K un 
I+K|K) 


K 
(; + zx) EN 


This can only happen if the open-loop gain constant K¡ K is infinite. In practice this 1s 
not possible and therefore the proportional control system proposed in Figure 4.23 
will always produce steady-state errors. These can be minimized by keeping the open- 
loop gain constant K¡K as high as possible. 

Since the closed-loop time-constant form equation (4.64) is 


T 
T.= (ax) (4.66) 


Then maintaining K¡K at a high value will reduce the closed-loop time constant and 
therefore improve the system transient response. 

This is illustrated in Figure 4.24 which shows a step change in r;(t) followed by a 
step change in ra(1). 


(4.65) 


Summary 

For a first-order plant, proportional control will always produce steady-state errors. 
This is discussed in more detail in Chapter 6 under “system type classification” where 
equations (6.63)46.65) define a set of error coefficients. Increasing the open-loop 


at) Steady-state 
Error 
| n(0 


K¡K large 


Pa(t) 


K¡K small 


Time(s) 


Fig. 4.24 Step response of a first-order plant using proportional control. 
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gain constant (which 1s usually achieved by increasing the controller gain K¡) will 
reduce, but not eliminate them. A high controller gain will also reduce the transient 
period. However, as will be shown in Chapters 5 and 6, high open-loop gain 
constants can result in the instability of higher-order plant transfer functions. 


4.5.3 Proportional plus Integral (PI) control 


Including a term that is a function of the integral of the error can, with the type of 
plant shown in Figure 4.23, eliminate steady-state errors. 
Consider a control law of the form 


u(t) = Kje(t) + K> 0 edt (4.67) 
Taking Laplace transforms 


Ss 


U(s) = (xa EE 2) E(s) 


=Ki (1 E =) E(s) (4.68) 


In equation (4.68), 7; is called the integral action time, and is formally defined as: 
“The time interval in which the part of the control signal due to integral action 
increases by an amount equal to the part of the control signal due to proportional 
action when the error is unchanging”. (BS 1523). 

Inserting the PI control law given in equation (4.68) into the first-order plant 
transfer function shown in equation (4.60) gives 


(KI + 1/TisRi(s) — C(5)) — RAS) K 
= (1+ 75) 


C(s) (4.69) 


which can be written as 
(T,TS + TA +K¡K), + K¡K)C(5) = K¡K(1 + T¡5s)Ri(s) — K¡ KT¡sRo(s) (4.70) 
Re-arranging gives 


(1 + Ti¡s)Ri(s) — Tis Ra(s) 


C(s) = (Ex) + T (14 gg) +1 


(4.71) 


The denominator is now in the standard second-order system form of equation 
(3.42). The steady-state response may be obtained using the final value theorem 
given in equation (3.10). 


c(1) = (1 +0)r1(1) — (O)ra(1) as t= 00 (4.72) 
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ct) 


ri(t) 


rot) 


Time (s) 
Fig. 4.25 Step response of a first-order plant using Pl control. 
When there are step changes in r,(1) and ra(1): 
1 +0)sR R 
Cs) — EDSR(S) _ q 22265 
Ss Ss 
= Ri(s) 
c(t) = ri(t) (4.73) 


Thus, when r;(*) and ra(t) are unchanging, or have step changes, there are no steady- 
state errors as can be seen in Figure 4.25. The second-order dynamics of the closed- 
loop system depend upon the values of 7;, T, K¡ and K. Again, a high value of K; will 
provide a fast transient response since it increases the undamped natural frequency, 
but with higher order plant transfer functions can give rise to instability. 


Summary 

For a first-order plant, PI control will produce a second-order response. There will be 
zero steady-state errors if the reference and disturbance inputs r;(1) and ra(1) are 
either unchanging or have step changes. The process of including an integrator within 
the control loop to reduce or eliminate steady-state errors is discussed in more detail 
in Chapter 6 under “system type classification”. 


Example 4.5 (See also Appendix 1, examp45.m) 
A liquid-level process control system is shown in Figure 4.26. The system parameters 
are 

A=2m? Ry = 15s/m? 


H¡=1V/m K,=0.1m*/sV K¡=1 (controller again) 


(a) What are the values of 7, and ( when the undamped natural frequency w, 1s 
0.1 rad/s? 

(b) Find an expression for the time response of the system when there is a step 
change of ha(t) from 0 to 4m. Assume zero initial conditions. 
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Control Valve 
u(í) K 


halt) /| | l vi(1) 
Pl 
Pink) Controller 
Tank 
Area A hal) 
] ] 0 | 
Outlet valve 
Pressure transducer Resistance Ay /1N V2tD 
H 


Fig. 4.26 Liquid-level process control system. 


The controller is given in equation (4.68). The inflow to the tank is 


v¡ (1) = Kyu(t) (4.74) 


The tank dynamics are expressed, using equation (2.63) as 


ha 
10 "»0)=4% (4.75) 
dí 
and the linearized outflow is 
hato) 
va(t) = Ri (4.76) 

The measured head h,,(1) is obtained from the pressure transducer 

hno) = Hiha(0) (4.77) 


From equations (4.75) and (4.76), the tank and outflow valve transfer function is 


14H AR:s 


Ha 
(s) 


7 (4.78) 


The block diagram for the control system is shown in Figure 4.27. From the block 
diagram, the forward-path transfer function G(s) 1s 


KK, Ri(1 +) 
KK, Re(1+ Tis) 
o TisC + ART) 


G(s) = 
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PI Controller Tank and valve 
Control valve 
Has) + Els) lia L U(s) K Vi(s) R Hals) 
Tis 1+AR;s 


Pressure tranducer 


HH; ¡« 


Fig. 4.27 Block diagram for liquid-level process control system. 


Using equation (4.4), the closed-loop transfer function becomes 


H K¡KyRi(1+T;5) 

a (AR1T¡s?+T;5) 

(s) = DERE (4.80) 
y (475) 

Ha 1+ ARTS +TO 


which simplifies to 


e ) K¡KyRr(1 + Tis) 
Ss) = 
(AR1T¡)5? + T(1+KXKRHp)s+K¡ K,yR¡H; 


(4.81) 


Equation (4.81) can be expressed in the standard form of equation (3.42) for a 
second-order system. 
Putting A; = 1, then 


Hay (1 +75) 
Ha (2) Dl + Ds +1 


(a) Comparing the denominator terms with the standard form given in equation (3.42) 


(4.82) 


AT; 1 
== 4.83 
ES wn paa 
1 26 
T, p1]= 4.84 
laz ) Dn ( ) 
From equation (4.83) 
ips ION 5 seconds 
"ARA 0.122 


From equation (4.84) 


WwnT; 1 
= 1 
S 2 (az se ) 


0.1 x 5 1 
Y (ara 1) 0417 
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(b) Inserting values into equation (4.82) 


Ha (1 +55) 
s)= 4.85 
Ha) = 100? 483454 1 75 
For a step input of height 4m 
0.01(1 +55) 4 
Hals) = 
()= [5008345 + 0.01] 5 
Expanding by partial fractions using 3.2.4 (1v) 
0.04 + 0.25 A Bs+C 
H.(s) = = 4, 
a) CG 2F0.08345+ 00D) 5 52 +0.08345 + 0.01 q19S) 
Multiplying through by s(s? + 0.0834s + 0.01) 
0.04 + 0.25 = A(s” + 0.0834s + 0.01) + Bs? + Cs 
Equating coefficients 
(%: 0=4+B 
(s):  0.2=0.08344 + C 
(s%) : 0.04 =0.014 
glving 
A=4 B=-4 C= -0.1336 
Substituting values back into (4.86) and complete the square to give 
4 —4s — 0.1336 
Hás==+4 pl (4.87) 


s — (s-+0.0417) + 0.09092 


Inverse transform using Laplace transform pairs (9) and (10) in Table 3.1. 


Hals =* ( E ) 1.469 ( peta ) 
s Us +0.0417) + 0.09092 (s + 0.0417)? + 0.0909? 


0.0417 
0.0909 


ha(t) = 4 — 4000417 (vos 0.09091 — sin 0.09091) 
— 1.46978 997 sin 0.0909: 


which simplifies to give 


ha(t) = 411 — ecos 0.0909: — 0.0913 sin 0.09091)] (4.88) 
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Fig. 4.28 Response of the Pl controlled liquid-level system shown in Figure 4.26 to a step change in hy(t) 
from 0 to 4 m. 


In equation (4.88) the amplitude of the sine term is small, compared with the cosine 
term, and can be ignored. Hence 


ha(t) = 4(1 — e 217 cos 0.09091) (4.89) 


The time response depicted by equation (4.89) is shown in Figure 4.28. 


4.5.4 Proportional plus Integral plus Derivative (PID) control 


Most commercial controllers provide full PID (also called three-term) control action. 
Including a term that is a function of the derivative of the error can, with high-order 
plants, provide a stable control solution. 

Proportional plus Integral plus Derivative control action is expressed as 


de 


7 (4.90) 


u(t) = Kje(t) + K> ] edt + K; 
Taking Laplace transforms 
K 
U(s) = (x $b Ko) Es) 


KK 
0 A 0 
( ED E ,) (s) 


= Ko PEÓN Tas) 1 (4.91) 
Tis 
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In equation (4.91), Ty is called the derivative action time, and is formally defined as: 
“The time interval in which the part of the control signal due to proportional action 
increases by an amount equal to the part of the control signal due to derivative action 
when the error is changing at a constant rate” (BS 1523). 

Equation (4.91) can also be expressed as 


U(s) (s) (4.92) 


KT Tas? + Tis + Da 
o Ts 


4.5.5 The Ziegler-Nichols methods for tuning PID controllers 


The selection of the PID controller parameters K¡, T;¡ and T¿ can be obtained using 
the classical control system design techniques described in Chapters 5 and 6. In the 
1940s, when such tools were just being developed, Ziegler and Nichols (1942) devised 
two empirical methods for obtaining the controller parameters. These methods are 
still in use. 

(a) The Process Reaction Method: This is based on the assumption that the open- 
loop step response of most process control systems has an S-shape, called the process 
reaction curve, as shown in Figure 4.29. The process reaction curve may be approxi- 
mated to a time delay D (also called a transportation lag) and a first-order system of 
maximum tangential slope R as shown in Figure 4.29 (see also Figure 3.13). 

The Process Reaction Method assumes that the optimum response for the closed- 
loop system occurs when the ratio of successive peaks, as defined by equation (3.71), 
is 4:1. From equation (3.71) it can be seen that this occurs when the closed-loop 
damping ratio has a value of 0.21. The controller parameters, as a function of R and 
D, to produce this response, are given in Table 4.2. 


clt 


DEA í(s) 


Fig. 4.29 Process reaction curve. 
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Table 4.2 Ziegler-Nichols PID parameters using the 
Process Reaction Method 


Controller type K; T, Ta 

P 1/RD - - 

PI 0.9/RD D/0.3 - 
PID 1.2/RD 2D 0.5D 


Table 4.3 Ziegler-Nichols PID parameters using the 
Continuous Cycling Method 


Controller type K; T, To 
P Ky/2 - - 
PI Ky/2.2 Tu/1.2 - 


PID Ki1.7 Tu/2 Tu/8 


Note that the Process Reaction Method cannot be used if the open-loop step 
response has an overshoot, or contains a pure integrator(s). 

(b) The Continuous Cycling Method: This is a closed-loop technique whereby, 
using proportional control only, the controller gain K; is increased until the system 
controlled output c(t) oscillates continually at constant amplitude, like a second- 
order system with no damping. This condition is referred to as marginal stability 
and is discussed further in Chapters 5 and 6. This value of controller gain is called 
the ultimate gain K,, and the time period for one oscillation of c(t) is called the 
ultimate period 7,,. The controller parameters, as a function of K,, and T,,, to provide 
a similar closed-loop response to the Process Reaction Method, are given in 
Table 4.3. 


The two Ziegler—Nichols PID tuning methods provide a useful “rule of thumb” 
empirical approach. The control system design techniques discussed in Chapters 5 
and 6 however will generally yield better design solutions. 

Of the two techniques, the Process Reaction Method is the easiest and least 
disruptive to implement. In practice, the measurement of R and Dis very subjective, 
and can lead to errors. 

The Continuous Cycling Method, although more disruptive, has the potential to 
give better results. There is the risk however, particularly with high performance 
servo-mechanisms, that if K, is increased by accident to slightly above the marginal 
stability value, then full instability can occur, resulting in damage to the system. 


Actuator saturation and integral wind-up 

One of the practical problems of implementing PID control is that of actuator 
saturation and integral wind-up. Since the range of movement in say, a control valve, 
has physical limits, once 1t has saturated, increasing the magnitude of the control 
signal further has no effect. However, if there is a difference between desired and 
measured values, the resulting error will cause a continuing increase in the integral 
term, referred to as integral wind-up. When the error term changes its sign, the 
integral term starts to “unwind,” and this can cause long time delays and possible 
instability. The solution is to limit the maximum value that the integral term 
can have. 
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4.5.6 Proportional plus Derivative (PD) control 


Proportional plus Derivative control action is expressed as 


de 


u(t) = K¡e(t) + K3 A (4.93) 
Taking Laplace transforms 
U(s) = K; (1 + E) E(s) 
= K¡(1 + Tas) E(s) (4.94) 


The inclusion of a derivative term in the controller generally gives improved damping 
and stability. This is discussed in more detail in Chapters 5 and 6. 


4.6 Case study examples 


Example 4.6.1 CNC Machine-Tool Positional Control (See also Appendix 1, 
examp461.m) 

The physical configuration and block diagram representation of a CNC machine- 
tool is shown in Figures 1.10 and 1.11. The fundamental control problem here is that, 
by design, the lead-screw (by the use of re-circulating ball-bearings) is friction-free. 
This means that the positional control system will have no damping, and will oscillate 
continuously at the undamped natural frequency of the closed-loop system. 

Damping can be introduced in a number of ways: 


(a) A dashpot attached to the lead-screw: This is wasteful on energy and defeats the 
objective of a friction-free system. 

(b) Velocity feedback: A signal from a sensor that is the first derivative of the 
output (1.e. velocity) will produce a damping term in the closed-loop transfer 
function. 

(c) PD control: A PD controller will also provide a damping term. However, the 
practical realization will require an additional filter to remove unwanted high 
frequency noise (see Chapter 6 for further details on lead-lag compensation). 


Most machine-tool manufacturers employ velocity feedback to obtain the necessary 
damping. Since overshoot in a cutting operation usually cannot be tolerated, the 
damping coefficient for the system must be unity, or greater. 

For this study, the machine-tool configuration will be essentially the same as 
shown in Figure 1.10, with the exception that: 


(1) A gearbox will be placed between the servo-motor and the lead-screw to provide 
additional torque. 

(11) The machine table movement will be measured by a linear displacement trans- 
ducer attached to the table. This has the advantage of bringing the table “within 
the control-loop” and hence providing more accurate control. 
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System element dynamic equations: With reference to Figures 1.11 and 4.31 


1. Controller 


Proportional control, gain K¡(V/m) 


(4.95) 
Control signal U¡(s) = K¡(Xa(s) — Xmí(s)) 


2. Power amplifier 


Gain K2(V/V) 


. (4.96) 

Control signal U2(s) = K>,(U;¡(s) — Ba(s)) 

3. DC servo-motor: Field controlled, with transfer function as shown in Figure 4.17. 

It will be assumed that the field time constant £f/Ry is small compared with the 

dynamics of the machine table, and therefore can be ignored. Hence, DC servo- 
motor gain K3 (Nm/V). 


Motor Torque Tin(s) = K3Ux(s) (4.97) 


4. Gearbox, lead-screw and machine-table: With reference to Figure 2.9 (free-body 
diagram of a gearbox), the motor-shaft will have zero viscous friction C,,, hence 
equation (2.22), using Laplace notation, becomes 


X(s) = UNO — Im.0m(s)) (4.98) 


The output shaft in this case is the lead screw, which is assumed to have zero moment 
of inertia /, and viscous friction C.. The free-body diagrams of the machine-table 
and lead-screw are shown in Figure 4.30. 
For lead-screw 
Work in = Work out 
PX(DOAD) = F(9xo(0) 


or 
0) 


F(0) =bX(0) ema 


(4.99) 


Xo(t), Xo(t), Xo(1) 
———— 
0(t) 


bX(1) m 


--- SO SOS 


le 


Fig. 4.30 Free-body diagrams of lead-screw and machine-table. 
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Now the pitch p of the lead-screw is 


E Xo(1) 


820 (4.100) 


Substituting (4.100) into (4.99) 


BX(O 


F()= (4.101) 


The equation of motion for the machine-table is 
F(0) =mxXo (4.102) 
Equating (4.101) and (4.102) gives 
1 a 
X(D =5 (Pomo) 


Taking Laplace transforms 


1 
X(s) = ¿(oms*Xo(s)) (4.103) 
Equating (4.98) and (4.103) gives 
pm Xos) = (Tol) — In20m(9) (4.104) 
Now 
b/a = gear ratio n 
Om (s) = n9(s) 
Hence 
S0m(s) =ns*0s) 
and 
Xols 
ay 20 (4.105) 
Equation (4.105) can be substituted into (4.104) 
pms?Xo(s) = nTm(s) — Pl XA) 
or 
A 
nT mts) = | pm+-=— |s*Xo(s) (4.106) 
Pp 


giving the transfer function for the gearbox, lead-screw and machine-table as 
Xo n 
(s) => 2 9) 
(pm + 1? Tn /p)s 


Tm 
where the term 1?/,,/p may be considered to be equivalent mass of /, referred to the 
machine-table. 


(4.107) 
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5. Tachogenerator 


Gain H) (V s/rad) 
Feedback signal B2(s) = H>s0.(s) (4.108) 


or, from equation (4.105) 


Bs) = sx o(s) (4.109) 


6. Position transducer 


Gain A¡(V/m) 
Feedback signal Xim(s) = H¡ Xo(s) (4.110) 


The system element dynamic equations can now be combined in the block diagram 
shown in Figure 4.31. Using equation (4.4), the inner-loop transfer function is 
K>K3np 


G ==! 
e (p2m + 1? L)s + K2K3nH) 


(4.111) 


Again, using equation (4.4), the overall closed-loop transfer function becomes 


X K¡K>K3n 
0) =35 id (4.112) 
Xa (p.m + 1? 1, )5? + K,K3nHo>s + K¡ K,K3npH; 
which can be written in standard form 

X 1 

o H 

(s) = ! (4.113) 
X "mt? Lo H, 
á (Aecaar) e+ (7) s+1 
Power DC Machine 
Controller Amplifier Servomotor Table ntegrator 
Ni Un(s) Us) Tm(s) n 52) E xxs) 
Mes  dg> > Mé lp JS <= Le» 
> A (pm E) Ss 
Xm(S 
(e) Ba(s) 
Tachogenerator 
s0o(s) 
Ho o 
Hi 


Position Transducer 


Fig. 4.31 Block diagram of CNC machine-tool control system. 
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Specification: The CNC machine-table control system is to be critically damped with 
a settling time of 0.1 seconds. 


Control problem: To select the controller gain K¡ to achieve the settling time and 
tachogenerator constant to provide critical damping. 


System parameters 
K,=2V/V  K3=4Nm/V 
n=10:1 p=5x10m 
m=50kg In =10x 107% kgm” 
H, = 60 V/m 
Calculation of K¡: In general, the settling time of a system with critical damping is 


equal to the periodic time of the undamped system, as can be seen in Figure 3.19. 
This can be demonstrated using equation (3.62) for critical damping 


xo(1) = [1 — e “(1 +w,0)] 


when 
t= 2/0 
xo(t) = [1 —e7(1 + 2m)] 
= 0.986 (4.114) 


Thus, for a settling time of 0.1 seconds for a system that is critically damped, the 
undamped natural frequency 1s 


DE - = 62.84 rad/s (4.115) 


Comparing the closed-loop transfer function given in equation (4.113) with the 
standard form given in (3.42) 


K¡K>,K3npH 
2 189K83NnpH1 
= | === 4.116 
Wi (a ) ( ) 
Hence 
K;= (p?m + Lia Ju? 
K>K3npH; 


KG x 1073)? x 50) + (10? x 10 x 1070) 
5 Qx4x10x5x 1073 x 60) 


= 0.365 V/V (4.117) 


| x 62.84? 


Again, comparing equation (4.113) with the standard form (3.42) 


26 Hh 


S (4.118) 
Wn  KipH; 
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Hence 
_ 2CKipH;y 
SiN 
_2x1x0.365x 5x 10? x 60 
62.84 
= 3.485 x 107? V s/rad (4.119) 


H) 


Example 4.6.2 Temperature control system (See also Appendix 1, examp462.m) 
The general form of a temperature control system is shown in Figure 1.6 with the 
corresponding block diagram given in Figure 1.7. 
The system variables are: 
0a(t) = Desired temperature ("C) 
Om (1) = Measured temperature (V) 
0o(t) = Actual temperature (*C) 
0s(t) = Temperature of surroundings (*C) 
u(t) = Control signal (v) 
v(t) = Gas flow-rate (m?/s) 
O¡(t) = Heat flow into room (J/s = W) 
Oo(t) = Heat flow though walls (W) 
System equations 


1. Controller: The control action is PID of the form given in equation (4.91) 


l 
U(s) = K; (1 + To + Tas) (Oa(s) — Om(s)) (4.120) 
É 
2. Gas solenoid valve: This is assumed to have first-order dynamics of the form 


K) 
1475 


where K> is the valve constant (m?/s V). 


56 Me (4.121) 


3. Gas burner: This converts gas flow-rate v(t) into heat flow Oj(t) 1.e.: 


Oi(s) = K3V(s) (4.122) 
where K3 is the burner constant (Ws/mí). 


4. Room dynamics: The thermal dynamics of the room are 


d0. 
Qi(t) — Qo(1) = Cr dr (4.123) 


Equation (4.123) is similar to equation (2.54), where Cr is the thermal capacitance 
of the air in the room. 
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The heat flow through the walls of the building is as given in equation (2.53), 1.e. 
(94(1) — Os(10)) 


Qo(t) = Re (4.124) 
where Rr 1s the thermal resistance of the walls, see equation (2.47). 
Substituting equation (4.124) into (4.123) gives 
] 01) — 0s(1) _ d0, 
Qi) — PRA = Ci dí (4.125) 
Multiplying through by Ry 
d0, 
RrQi() + 0s(0 =90(0) + RrCrG, (4.126) 
Taking Laplace transforms 
RrQi(s) + 0s(s) = (1 + RrCrsj0(s) (4.127) 


Equation (4.127) can be represented in block diagram form as shown in Figure 4.32. 


5. Thermometer: The thermometer equation is 


Om(s) = H10o(s) (4.128) 


The complete block diagram of the temperature control system is shown in Figure 
4.33. 
From Figure 4.33 


K¡K,K3 RUT Tas? + Tis + 1)(04(s) — H100(5) 


HOs(s) =(1 + RrCrs)0(s) (4.129) 


Ts(1 + 715) 
0s(s) 
Q(s) > 1 0(s) 
+ des + » 1+RiCrs á 
Fig. 4.32 Block diagram representation of the thermal dynamics of the room. 
0s(s) 
PID Controller Valve Burner Room 
04S) 1 Us xk Us 06) + 0.(s) 
Ki 1+2+T,s 2 R 1 
0 (s) d Tis d ) » 1+ Tis » Ks » Ñ + d 1 + RiCrs 
m 


He 


Fig. 4.33 Block diagram of temperature control system. 
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Equation (4.129) can be re-arranged to give 


FAT, Tas? + Tis + D0a(s) + EA Os) 


Bols) = En (4.130) 
(aa) + (Ea + 7, Ta)? + mln +1)s+1 
where the forward-path gain Kp 1s 
Kp = K¡K,K3Rr (4.131) 


Control problem: Given the system parameters, the control problem is to determine 
the controller settings for K¡, T;¡ and T¿. This will be undertaken using the Zeigler— 
Nichols process reaction method described in Section 4.5.5(a). 


System parameters: 


K>,K; =5W/V Rr = 0.1 Ks/J 
Cr = 80J/K H¡=1.0V/K 
T¡ = 4 seconds 


Process reaction curve: This can be obtained from the forward-path transfer function 


0 K,K3Rr 
s)= 4.132 
US = TFT + RICH) A 
Inserting values into equation (4.132) gives 
0 0.5 
2 (5) = (4.133) 


U (1 +45(0 +85) 


Figure 4.34 shows the response to a unit step, or the process reaction curve. 
From the R and D values obtained from the process reaction curve, using the 
Zeigler-Nichols PID controller settings given in Table 4.2 


K¡ =1.2/RD = 26.144 
T;, = 2D = 3.0 seconds 
Ta = 0.5D = 0.75 seconds 


Assuming that the temperature of the surroundings 0s(t) remains constant, the 
closed-loop transfer function (using equation (4.130)) for the temperature control 
system, 1s 

9. E (2.25? + 35 + 1) 
2 7,34453 + 5.004s? + 3.2295 + 1 


(4.134) 


The response to a step change in the desired temperature of 0-20*C for the closed- 
loop transfer function given by equation (4.134) is shown in Figure 4.35. 
From Figure 4.35, the ratio of successive peaks is 


a 892 
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Fig. 4.34 Process reaction curve for the temperature control system shown in Figure 4.33. 
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Fig. 4.35 Closed-loop step response of temperature control system using PID controller tuned using 
Zeigler—Nichols process reaction method. 


This corresponds to a damping ratio of 0.23. These values are very close to the 
Zeigler—-Nichols optimum values of 4.0 and 0.21 respectively. 


Example 4.6.3 Ship Autopilot (See also Appendix 1, examp463.m) 
A ship has six degrees-of-freedom, i.e. 1t is free to move in six directions simultan- 
eously, namely three linear motions — surge (forward), sway (lateral) and heave 
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(vertical) together with three rotational motions — roll, pitch and yaw. This analysis 
considers rotation about the yaw axis (1.e. heading control) only. 

Figure 1.12 shows a typical ship autopilot system and Figure 1.13 shows the 
corresponding block diagram. Rotation about the yaw axis 1s in effect rotation about 
the z, or vertical axis of the vessel, called the “r” direction since r is the symbol for 
yaw-rate. Hence hydrodynamic coefficients for the yaw axis are therefore given the 
subscript “r”. Yaw hydrodynamic coefficients are given the symbol 'N”. In this 
analysis the dynamics of the steering gear are neglected. 

The system variables are 


W¿(t) = Desired heading (radians) 
y. (1) = Actual heading (radians) 
ó(t) = Rudder angle (radians) 


Figure 4.36 shows the hull free-body diagram. Disturbance effects (wind, waves and 
current) are not included. 


System equations 

1. Hull dynamics: ln Figure 4.36, X¿ Y, is the earth co-ordinate system where X, is 
aligned to north. All angles are measured with respect to X¿. A consistent right- 
hand system of co-ordinates is used, with the exception of the rudder-angle, which 
has been selected to be left-hand to avoid negative coefficients in the hull transfer 
function. 


Xo 


Actual Course 
+ 


Desired Course 


Fig. 4.36 Free-body diagram of ship hull dynamics. 
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From Figure 4.36 the equation of motion for the yaw axis is 
Y Mo = Lbalo) 
(NsS(0) — (NAdA(O) = Loba 
Taking Laplace transforms 
Nsó(s) = (Las? + Nis)bals) 
Hence the hull transfer function becomes 


Va (5) _— Ns 
9%” sULs+N,) 


(4.136) 


(4.137) 


(4.138) 


2. Control action: In this case, the autopilot (controller) is considered to provide 


proportional control only. 


0(s) = Ki(bals) — Vals) 


(4.139) 


3. Gyro-compass: This provides a measured heading proportional to the actual 


heading 
Um(s) = Hivals) 


(4.140) 


Combining equations (4.138), (4.139) and (4.140) produces the block diagram shown 


in Figure 4.37. 
Using equation (4.4), the closed-loop transfer function is 


K¡KoNa 
Va (5) = UND 

e Ki¡K>N5Hi 
Va — ss +N;) 


Equation (4.141) simplifies to give 
1 


a ()= l = N 
id (rr) AF (ator)s + l 


Hull 


Steering Rudder Dynamics 


Autopilot Gear Characteristics 


A 
O a NET 


Gyro-Compass 


HH, [e 


Fig. 4.37 Block diagram of ship autopilot control system. 


(4.141) 


(4.142) 


Va(S) 
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Equation (4.142) is in the standard form given in equation (3.42). 


Control problem: For a specific hull, the control problem is to determine the autopilot 
setting (K1) to provide a satisfactory transient response. In this case, this will be when 
the damping ratio has a value of 0.5. Also to be determined are the rise time, settling 
time and percentage overshoot. 


System parameters: The ship to be controlled is a cargo vessel of length 161 m with a 
MARINER type hull of total displacement 17000 tonnes. 


K,= 1.0rad/V N5= 80 x 10% Nm/rad 
N,=2x 10? Nms/rad L=20x 10? kg m? 
H, =1.0 V/rad 


Inserting values into equation (4.142) gives 
Va 1 
7 () = 20x109_ Y 2 2x 109 1 
Rix80x100)5 + zo0x10s)* + 


(4.143) 


which simplifies to 


Pay : (4.144) 


Da (2) + (3) s+1 


Comparing equation (4.144) with the standard form given in equation (3.42) 


1 250 
S=> 4.145 
a (4.145) 
and 
2( 25 
=> 4.14 
a (4.146) 
Given that € = 0.5, then from equation (4.146) 
K; 
=> 4.14 
Wn 25 ( 7) 
Substituting (4.147) into (4.145) gives 
252 250 
Ki Ki 
Hence 
625 
Ki=5=2. 4.148 
1=>5 5 ( ) 
and from equation (4.147), 
Wn = 25 = 0.1 rad/s (4.149) 
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1.4 


1.2 


Actual Heading (rad) 


0 10 20 30 40 50 60 70 80 90 100 
Time (s) 


Fig. 4.38 Unit step response of ship autopilot control system. RiseTime (to 95%) = 23 seconds; 
Percentage Overshoot = 16.3%; 
Settling time (to +2%) = 81 seconds. 


From equations (3.58) and (3.59) the unit step response for the ship autopilot control 
system is given by the expression 


Pale) = 1 — ecos 0.08661 + 0.577 sin 0.08661) (4.150) 


Figure 4.38 shows the system unit step response. From Figure 4.38 


4.7 Further problems 


Example 4.7 
For the block diagrams shown in Figure 4.39 find an expression for the complete 
output when all inputs act simultaneously. 


Solutions 


(a) CS (GUS) GASGCAS)RI(S) + GDA + GASES )RAS) 
3) =17 600 + GH) +615)G6A5963(5)H(s) 


(b) C(5) (615) GAS) Gs) Ga Ss) Rs) — (61 (5)G2(5)G3(s)Ga(s)H (5) Ro(s) — (G3(s)Ga(s))R3(s) 
BES 1+G (HAS) + E (5)GASG (SCA) Hs) 


Example 4.8 

The speed control system shown in Figure 4.40 consists of an amplifier, a field- 
controlled DC servomotor and a tachogenerator. The load consists of a mass of 
moment of inertia 7 and a fluid damper C. The system parameters are: 


I=0.75kgm? C=0.5Nms/rad 
K, =5Nm/A H; =0.1 Vs/rad 
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Ha 
Ro 
Ri + +y_ A Ha: 
. E 9_% | aL 
Ho 
H 
(a) 
R; E 
» Gs > 
+ 
Y 
(b) Po 
Fig. 4.39 Block diagrams for closed-loop systems. 
Amplifier l, = constant 
vd) Field y 
Tachogenetator 


Hr 


vo(1) 


D.C. Servo-motor 


Fig. 4.40 Speed control system. 


Find the value of K¡ to give the system a closed-loop time constant of one second. 
What is the steady-state value of w,(t) when v;(t) has a value of 10 V. 


Solution 
0.5A/V 
33.3 rad/s 
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Error 
Detector 


Velocity Feedback 


, = constant 


K¿ Gear ratio 'n' A 


> Tachogenerator 
¿93 
0) == 
=L 


Field Controlled 
D.C. Servo-motor 


Amplifier 


Positional Feedback 


Fig. 4.41 Angular positional control system. Ki = Error detector gain (V/rad); K2 = Amplifier gain (A/V); 
K3 = Motor constant (Nm/A); n = Gear ratio; H, = Tachogenerator constant (V s/rad); /, = Load moment 
of inertia (kg m?); C, = Load damping coefficient (Nms/rad). 


Example 4.9 
Find an expression for the closed-loop transfer function relating 6¡(s) and 0.(s) for 
the angular positional control system shown in Figure 4.41. 


Solution 
0 1 


0; (s) 7 ( Lo )> (as 1 


K¡K>,K3n K¡K>,K3n 


Example 4.10 

A hydraulic servomechanism consists of the spool-valve/actuator arrangement 
shown in Figure 4.19 together with a “walking beam” feedback linkage as shown in 
Figure 4.42. The spool-valve displacement xy(*) is given by the relationship 


a > 

xi(1) 
a Spool-Valve 

-——> X(1) 
YT ===. 
b 

Hydraulic Actuator 

Y eL. e e ad e m 

A 

Xo(t) 


Fig. 4.42 Hydraulic servomechanism with “walking bear' feedback linkage. 
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Amplifier Actuator 


ICA E 000 
e) E > S(T+0.58) 


Sensor 


3 ¡4 


Fig. 4.43 Block diagram of a servomechanism. 


xy(1) = 6 - 5) xi(0) 6 . 5) xolí) 


If the forward-path transfer function is given by equation (4.57), find an expression for 
the closed-loop transfer function relating X¡(s) and X.(s). The system parameters are 


m=50kg V,=4x103m* f=1.4GPa 
A=0.01 m? K¿=10.0m%s — K.¿=6x102m*/Ns 
C)=6x10"m"/Ns a=b=0.15m 


Solution 


Xy 500 
Xi 0.357x 10653 40.12 x 10352 +5 + 500 


Example 4.11 

A servomechanism consists of an amplifier, actuator and sensor as shown in block 
diagram form in Figure 4.43. If the input to the system is a constant velocity of the 
form 


0(t) = 21 


find an expression for the time response of the system. 


Solution 


0.(1) = 0.6671 — 0.0222 + e” '(0.0222cos 7.681 — 0.083 sin 7.681) 


Example 4.12 

Figure 4.44 shows the elements of a closed-loop temperature control system. A 
proportional controller compares the desired value 6¡(+) with the measured value 
vo(t) and provides a control signal u(t) of K¡ times their difference to actuate the valve 
and burner unit. The heat input to the oven O;(t) is K, times the control signal. 
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Proportional 
Controller Valve/Burner 
f Q(t) Thermometer 
00 A u(t a f 
————— | a A 2 > 
el C 0(t) 
volt) L= 


Measurement Systems 


K < 


Fig. 4.44 Closed-loop temperature control system. 


The walls of the oven have a thermal resistance Ry and the oven has a thermal 
capacitance Cy and operating temperature 0.(t). The heat transfer equation for the 
oven may be written 


0). d0, 
Rr 00 dí 


Qi(1) — 


The thermometer and measurement system feed a measured value of A times 0,(1) to 
the controller. The system parameters are 


K =5 K=15SJ/V H,¡=1V/K 
RT = 2K/J Cr = 25 Js/W 


Find 

(a) The open-loop time constant 

(b) The closed-loop time constant 

(c) The percentage steady-state error in the output when the desired value is con- 
stant. 


Solution 

(a) 50 seconds 
(b) 3.125 seconds 
(c) 6.25% 


Example 4.13 
Figure 4.45 shows the block diagram representation of a process plant being con- 
trolled by a PID controller. 


(a) Find an expression for the complete response C(s) when Ri(s) and Ra(s) act 
simultaneously. 

(b) Using the Ziegler—Nichols Process Reaction Method, determine values for K;, T; 
and T¿ when 7, = 10 seconds and T) = 20 seconds. 
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PID Controller Re(s) Process Plant 
+|+ 
Ri(s) + E 4 Cls) 


a 
Ko[1+ Ts + Tas) (+Tis1+ 728) 


Fig. 4.45 Process plant under PID control. 


(c) Insert the values into the expression found in (a). Using MATLAB, or otherwise, 
determine the response c(t) when r,(t) is a unit step and r2(1) is zero. What is the 
ratio of successive peaks? 


Solution 


KT, Tas? + Tis + D)R1(s) + T,¡sR2(s) 
T,¡T ¡Tos + T(T) +72, +XK¡T 98? + TA +XK1)s+XK 


(b) K¡ =17.2 T¡=6 seconds Ty¿= 1.5 seconds 


17.2(95? + 65 + 1) 
s(120053 + 334.852 + 109.25 + 17.2) 


2.75 


(a) C(s) = 


(c) C(s) = 
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s-plane 


5.1 Stability of dynamic systems 


The response of a linear system to a stimulus has two components: 


(a) steady-state terms which are directly related to the input 
(b) transient terms which are either exponential, or oscillatory with an envelope of 
exponential form. 


If the exponential terms decay as time increases, then the system is said to be stable. If 
the exponential terms increase with increasing time, the system is considered unstable. 
Examples of stable and unstable systems are shown in Figure 5.1. The motions 
shown in Figure 5.1 are given graphically in Figure 5.2. (Note that (b) in Figure 
5.2 does not represent (b) in Figure 5.1.) The time responses shown in Figure 5.2 can 
be expressed mathematically as: 

For (a) (Stable) 


Xxo(1) = 4e 7” sin(wt + db) (5.1) 
For (b) (Unstable) 
Xxo(1) = 4e” sin(wt + $) (5.2) 
For (c) (Stable) 
xo(1) = 4e * (5.3) 
For (d) (Unstable) 
xo(1) = Ae” (5.4) 


From equations (5.1)-(5.4), it can be seen that the stability of a dynamic system 
depends upon the sign of the exponential index in the time response function, which 
is in fact a real root of the characteristic equation as explained in section 5.1.1. 


Classical design in the s-plane 


) Stable ) Unstable 
¿ Sa 
PESA 7 ¡Ñ / 
N 
) Stable (d) Unstable 


Fig. 5.1 Stable and unstable systems. 


Xo(1) 


Xo(1) Xo(1) 


O 


t t 
(c) (a) 


Fig. 5.2 Graphical representation of stable and unstable time responses. 
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5.1.1 Stability and roots of the characteristic equation 


The characteristic equation was defined in section 3.6.2 for a second-order system as 


a? +bs+c=0 (5.5) 
The roots of the characteristic equation given in equation (5.5) were shown in section 
3.6.2. to be 
—=b+y b?2 — 4ac 
$1, 2 = 2a (5.6) 


These roots determine the transient response of the system and for a second-order 
system can be written as 


(a) Overdamping 


$1 = —01 


(5.7) 
$2 = —02 
(b) Critical damping 
$1 =593 =->0 (5.8) 
(c) Underdamping 
$1, 52 ==—0 + ju (5.9) 


If the coefficient b in equation (5.5) were to be negative, then the roots would be 


$1, 52 =+0 + ju (5.10) 


The roots given in equation (5.9) provide a stable response of the form given in 
Figure 5.2(a) and equation (5.1), whereas the roots in equation (5.10) give an 
unstable response as represented by Figure 5.2(b) and equation (5.2). 

The only difference between the roots given in equation (5.9) and those in equation 
(5.10) is the sign of the real part. If the real part o is negative then the system is stable, 
but if 1t is positive, the system will be unstable. This holds true for systems of any 
order, so in general it can be stated: “If any of the roots of the characteristic equation 
have positive real parts, then the system will be unstable”. 


5.2 The Routh-Hurwitz stability criterion 


The work of Routh (1905) and Hurwitz (1875) gives a method of indicating the 
presence and number of unstable roots, but not their value. Consider the character- 
istic equation 


aa iaa =0 (5.11) 
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The Routh-Hurwitz stability criterion states: 


(a) For there to be no roots with positive real parts then there is a necessary, but not 
sufficient, condition that all coefficients in the characteristic equation have the 
same sign and that none are zero. 


If (a) above is satisfied, then the necessary and sufficient condition for stability is either 


(b) all the Hurwitz determinants of the polynomial are positive, or alternatively 
(c) all coefficients of the first column of Routh's array have the same sign. The 
number of sign changes indicate the number of unstable roots. 


The Hurwitz determinants are 


D D a. 43 
A A a (5.12) 
a da3z ds  d7 
dad d3 ds do 4 d4  d6 
D3=la4w 4 4, Da¿= 4 43 4s etc. 
a 43 da da 


Routh's array can be written in the form shown in Figure 5.3. 
In Routh's array Figure 5.3 


1 1 


An— An— An An— 
bi 5 n—1 n—3 2 = n—1 n—5 eto. (5.13) 
An-1| An An-2 An—1 | An An—4 
115 b 115 b 
aq==|" E a==| " ó etc. (5.14) 
by An-1 An-3 by dn-1 An-=5 


Routh's method is easy to apply and is usually used in preference to the Hurwitz 
technique. Note that the array can also be expressed in the reverse order, commen- 
cing with row s”. 


> 19] 
s 4 
3 
s" Ci C> Ca 
2 
Ss" b; b, ba 
n-1 
Ss an-1 an-3 án-5 
n 
Ss an an-2 an-4 


Fig. 5.3 Routh' array. 
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Example 5.1 (See also Appendix 1, A1.5) 
Check the stability of the system which has the following characteristic equation 
“427543 44542=0 (5.15) 


Test 1: All coefficients are present and have the same sign. Proceed to Test 2, ¡.e. 
Routh's array 


so 2 

s! 8 

val =k 2 (5.16) 
5 2 

e 2 


The bottom two rows of the array in (5.16) are obtained from the characteristic 
equation. The remaining coefficients are given by 


¡YE | 
br =3|; [30-01 (5.17) 

112 0] _1 
br =3|; >| -34-0=2 (5.18) 
b3=0 (5.19) 

12 

a==115 ¿1408 (5.20) 
c=0 (5.21) 

E E! 
=p 5 >| =gus=0=2 (5.22) 


In the array given in (5.16) there are two sign changes in the column therefore there 
are two roots with positive real parts. Hence the system is unstable. 


5.2.1 Maximum value of the open-loop gain constant for the 
stability of a closed-loop system 


The closed-loop transfer function for a control system is given by equation (4.4) 


Co 65) 
ROSTIEGOHO 


(5.23) 


In general, the characteristic equation is most easily formed by equating the denomi- 
nator of the transfer function to zero. Hence, from equation (5.23), the characteristic 
equation for a closed-loop control system is 


1+G(9H(s)=0 (5.24) 
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Proportional Control 
Controller Valve Plant 
AS) + y pr á Cís) 
p ; s (s+5+2) 


Fig. 5.4 Closed-loop control system. 


Example 5.2 (See also Appendix 1, examp52.m) 
Find the value of the proportional controller gain K¡ to make the control system 
shown in Figure 5.4 just unstable. 


Solution 
The open-loop transfer function is 


G(s)H(s) = +3 (5.25) 
The open-loop gain constant is 
K=8K; (5.26) 
glving 
G(s)H(s) = A (5.27) 
s(s? + s +2) 
From equation (5.24) the characteristic equation is 
ql s(s? = a Ñ id 
or 
(*+s+D+4K=0 (5.29) 
which can be expressed as 
+*%+25+K=0 (5.30) 


The characteristic equation can also be found from the closed-loop transfer function. 
Using equation (4.4) 

G(s) 
1 + G(s)H(s) 


C 
q 6) = 


Given the open-loop transfer function in equation (5.27), where H(s) is unity, then 


K 
C s(s2+s+ 
q6)= => (5.31) 
1 
s(s245+2) 
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Multiplying numerator and denominator by s(s? + s + 2) 
C K 


s)= 32 
ROT DE K (992) 
C K 
R Ms $+94254+K e 
Equating the denominator of the closed-loop transfer function to zero 
*S+e+2+K=0 (5.34) 


Equations (5.30) and (5.34) are identical, and both are the characteristic equation. It 
will be noted that all terms are present and have the same sign (Routb's first 
condition). Proceeding straight to Routh's array 


so K 


s 2-K 
b ( (5.35) 


where 


b,=0 

cq=XK 
To produce a sign change in the first column, 

K>2 (5.36) 
Hence, from equation (5.26), to make the system just unstable 
Ki =0.25 
Inserting (5.36) into (5.30) gives 
*+3+425+2=0 


factorizing gives 
(5 +25+1)=0 


hence the roots of the characteristic equation are 


s=-—1 


s= 0+jv2 


and the transient response is 
c(1) = 4e' + Bsin(v2t+ $) (5.37) 


From equation (5.37) 1t can be seen that when the proportional controller gain K; is 
set to 0.25, the system will oscillate continuously at a frequency of y2 rad/s. 
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5.2.2 Special cases of the Routh array 


Case 1: A zero in the first column 

If there is a zero in the first column, then further calculation cannot normally proceed 
since it will involve dividing by zero. The problem is solved by replacing the zero with 
a small number e which can be assumed to be either positive or negative. When the 
array is complete, the signs of the elements in the first column are evaluated by 
allowing e to approach zero. 


Example 5.3 
+27 +29 4454 3=0 
so 3 
s! 4 — 6le 
s? € 3 (5.38) 
> 2 4 
se 1 2 3 


Irrespective of whether e is a small positive or negative number in array (5.38), there 
will be two sign changes in the first column. 


Case 2: All elements in a row are zero 
If all the elements of a particular row are zero, then they are replaced by the 
derivatives of an auxiliary polynomial, formed from the elements of the previous row. 


Example 5.4 
+2 +68 + 128 +85+16=0 
s 16 
s! 8/3 
? 6 16 
E yde (5.39) 
$ 2 12 16 
Sl 1 6 8 


The elements of the s? row are zero in array (5.39). An auxiliary polynomial P(s) is 
therefore formed from the elements of the previous row (s%). 
1.0. 
P(s) = 25* + 125? + 16 
dP(s) 
ds 


85? + 245 (5.40) 


The coefficients of equation (5.40) become the elements of the s* row, allowing the 
array to be completed. 
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5.3 Root-locus analysis 


5.3.1 System poles and zeros 


The closed-loop transfer function for any feedback control system may be written in 
the factored form given in equation (5.41) 


C a G(s) _Kads— Za1 (ls — Zc2) . . .(S — Zen) 
R"” >  1+G(sH(s) — (s—paMs— Pe)... (S— Pen) 


where s= Pel, Pe2)---> Pen are closed-loop poles, so called since their values make 
equation (5.41) infinite (Note that they are also the roots of the characteristic 
equation) and s= Zc1, Z02,--., Zen are closed-loop zeros, since their values make 
equation (5.41) zero. 

The position of the closed-loop poles in the s-plane determine the nature of the 
transient behaviour of the system as can be seen in Figure 5.5. Also, the open-loop 
transfer function may be expressed as 


(5.41) 


K(s — — (S — Zn 
G()H(s) = (s — Zo1 Ms — 202) - - . (Ss — Zon) (5.42) 
(s — pos — poz) . . .(S — Pon) 
where Z01, Z02,---, Zon are open-loop zeros and po1, Po2,---, Pon are open-loop poles. 


S 
/ y 1 
AO / 
N SS, E 
1 / 
/ SN 
Ñ 
N 


—> k 


Xx 


Fig. 5.5 Effect of closed-loop pole position in the s-plane on system transient response. 
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5.3.2 The root locus method 


This is a control system design technique developed by W.R. Evans (1948) that 
determines the roots of the characteristic equation (closed-loop poles) when the 
open-loop gain-constant K is increased from zero to infinity. 

The locus of the roots, or closed-loop poles are plotted in the s-plane. This is a 
complex plane, since s = 0 +juw. It is important to remember that the real part o is 
the index in the exponential term of the time response, and if positive will make the 
system unstable. Hence, any locus in the right-hand side of the plane represents an 
unstable system. The imaginary part w is the frequency of transient oscillation. 

When a locus crosses the imaginary axis, dr = 0. This is the condition of marginal 
stability, i.e. the control system is on the verge of instability, where transient oscilla- 
tions neither increase, nor decay, but remain at a constant value. 

The design method requires the closed-loop poles to be plotted in the s-plane as K 
is varied from zero to infinity, and then a value of K selected to provide the necessary 
transient response as required by the performance specification. The loci always 
commence at open-loop poles (denoted by x) and terminate at open-loop zeros 
(denoted by o) when they exist. 


Example 5.5 
Construct the root-locus diagram for the first-order control system shown in 
Figure 5.6. 


Solution 
Open-loop transfer function 
G(SH(s) = a (5.43) 
Ts 
Open-loop poles 
s=0 


Open-loop zeros: none 
Characteristic equation 


1+G(sSHA(s) =0 
Substituting equation (5.3) gives 


Le. Ts+K= (5.44) 


Fig. 5.6 First-order control system. 
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Fig. 5.7 Root-locus diagram for a first-order system. 
Roots of characteristic equation 


s==>3 5.45 
7 (5.45) 
When K'is varied from zero to infinity the locus commences at the open-loop pole 
s= 0 and terminates at minus infinity on the real axis as shown in Figure 5.7. 
From Figure 5.7 it can be seen that the system becomes more responsive as K is 
increased. In practice, there is an upper limit for K as signals and control elements 


saturate. 
Example 5.6 
Construct the root-locus diagram for the second-order control system shown in 
Figure 5.8. 
Open-loop transfer function 

G(SH(s) = ee (5.46) 

s(s +4) 
Open-loop poles 
s=0,-4 


Open-loop zeros: none 
Characteristic equation 


1 + G(sSH(s) =0 


s(s+ 4) 


Fig. 5.8 Second-order control system. 
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Table 5.1 Roots of second-order characteristic 
equation for different values of K 


K Characteristic equation Roots 

0 s4+4s=0 s=0,-4 

4 s+454+4=0 s=-2+j0 

8 s+45+8= s=-2+32 
16 s2.+4s+16=0 s=-2+j3.46 


Substituting equation (5.4) gives 
K 
s(s+4) 0 
Le. s+4s+K=0 (5.47) 


1+ 


Table 5.1 shows how equation (5.7) can be used to calculate the roots of the 
characteristic equation for different values of K. Figure 5.9 shows the corresponding 
root-locus diagram. 

In Figure 5.9, note that the loci commences at the open-loop poles (s = 0, —-4) 
when K =0. At K =4 they branch into the complex space. This is called a break- 
away point and corresponds to critical damping. 


Fig. 5.9 Root locus diagram for a second-order system. 
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5.3.3 General case for an underdamped second-order system 


For the generalized second-order transfer function given in equation (3.43), equating 
the denominator to zero gives the characteristic equation 


e +25 +4%=0 (5.48) 
If € < 1 in equation (5.48), then the roots of the characteristic equation are 


S$1,$2 = —CWn al Jun Y 1 — 6 (5.49) 


Hence a point P in the s-plane can be represented by Figure 5.10. 
From Figure 5.10, Radius 


OP = y (Gun + (o, vl- 2) (5.50) 


Simplifying (5.50) gives 


OP = 4 (5.51) 
Also from Figure 5.10 
PA, PO 1 IR (5.52) 
Un 


Thus, as € is varied from zero to one, point P describes an arc of a circle of radius w,, 
commencing on the imaginary axis (6 = 907) and finishing on the real axis (8 = 09). 


Limits for acceptable transient response in the s-plane 
If a system is 


(1) to be stable 
(2) to have acceptable transient response (( > 0.5) 


Cn O 0 


Fig. 5.10 Roots of the characteristic equation for a second-order system shown in the s-plane. 
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Unacceptable 
Acceptable Region 
Region (<> 0.5) 


Fig. 5.11 Region of acceptable transient response in the s-plane for € > 0.5. 


then the closed-loop poles must lie in an area defined by 


=+c0s 10.5 = +60" (5.53) 


This is illustrated in Figure 5.11. 


5.3.4 Rules for root locus construction 


Angle and magnitude criteria 
The characteristic equation for a closed-loop system (5.24) may also be written as 
G(SH(s) =—1 (5.54) 


Since equation (5.54) is a vector quantity, 1t can be represented in terms of angle and 
magnitude as 


G(s)H(s) = 180" (5.55) 
ONO) 
[G(s)H(s)| = 1 (5.56) 


The angle criterion 
Equation (5.55) may be interpreted as “For a point s¡ to lie on the locus, the sum of 
all angles for vectors between open-loop poles (positive angles) and zeros (negative 
angles) to point s, must equal 1807.” 

In general, this statement can be expressed as 


> Pole Angles — Y Zero Angles = 180” (5.57) 
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Fig. 5.12 Application of the angle criterion. 


Example 5.7 
Consider an open-loop transfer function 


K(s + a) 
sis + bs +.) 


G(sSH(s) = 


Figure 5.12 shows vectors from open-loop poles and zeros to a trial point s¡. From 
Figure 5.12 and equation (5.57), for s; to lie on a locus, then 


(01 +02 + 03) — (61) = 180" (5.58) 


The magnitude criterion 
If a point s¡ lies on a locus, then the value of the open-loop gain constant K at that 
point may be evaluated by using the magnitude criterion. 

Equation (5.56) can be expressed as 


IN 
Kio) se 63) 
or 
1065) 
KI o) ds 


Equation (5.60) may be written as 


_ Product of pole vector magnitudes 


= : 61 
Product of zero vector magnitudes (2:01) 
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ju 


Iwl 


Fig. 5.13 Application of the magnitude criterion. 


For Example 5.7, if s¡ lies on a locus, then the pole and zero magnitudes are shown in 
Figure 5.13. From Figure 5.13 and equation (5.61), the value of the open-loop gain 
constant K at position sy is 


XV |z 
k=! 1 | (5.62) 


If there are no open-loop zeros in the transfer function, then the denominator of 
equation (5.62) is unity. 


5.3.5 Root locus construction rules 


50 


Starting points (K = 0): The root loci start at the open-loop poles. 

Termination points (K = 00): The root loci terminate at the open-loop zeros when 
they exist, otherwise at infinity. 

Number of distinct root loci: This is equal to the order of the characteristic equation. 
Symmetry of root loci: The root loci are symmetrical about the real axis. 

Root locus asymptotes: For large values of k the root loci are asymptotic to 
straight lines, with angles given by 


(142) 


q (n—m) 


where 
k=0,1,...(mM-—m-—l) 
n = no. of finite open-loop poles 
m =no0. of finite open-loop zeros 
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6. Asymptote intersection: The asymptotes intersect the real axis at a point given by 


_ XX open-loop poles — X open-loop zeros 


CT: 

j (n— m) 

7. Root locus locations on real axis: A point on the real axis is part of the loci ifthe sum 
of the number of open-loop poles and zeros to the right ofthe point concerned is odd. 

8. Breakaway points: The points at which a locus breaks away from the real axis can 
be calculated using one of two methods: 


(a) Find the roots of the equation 


dK 


e 


S=046 
where K has been made the subject of the characteristic equation 1.e. K=... 
(b) Solving the relationship 


m 


dl 1 1 
Za (0% + lps) 2 (or + 25) 


where [p;| and |z;| are the absolute values of open-loop poles and zeros and 
oy 1s the breakaway point. 


9. Imaginary axis crossover: The location on the imaginary axis of the loci (mar- 
ginal stability) can be calculated using either: 


(a) The Routh-Hurwitz stability criterion. 
(b) Replacing s by juw in the characteristic equation (since a = 0 on the imagin- 
ary axis). 


10. Angles of departure and arrival: Computed using the angle criterion, by position- 
ing a trial point at a complex open-loop pole (departure) or zero (arrival). 

11. Determination of points on root loci: Exact points on root loci are found using the 
angle criterion. 

12. Determination of K on root loci: The value of K on root loci is found using the 
magnitude criterion. 


Example 5.5 (See also Appendix 1, examp38.m and examp38a.m) 
A control system has the following open-loop transfer function 


iS REE TOTES 

(a) Sketch the root locus diagram by obtaining asymptotes, breakaway point and 
imaginary axis crossover point. What is the value of K for marginal stability? 

(b) Locate a point on the locus that corresponds to a closed-loop damping ratio of 
0.5. What is the value of K for this condition? What are the roots of the 
characteristic equation (closed-loop poles) for this value of K? 
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Solution 
Part (a) 


Open loop poles: s=0,-2,-5 n=3 
Open-loop zeros: none m=0 


Asymptote angles (Rule 5) 


RO 
=== 60%, k=0 
(+2) 
0, = =xfr=180, k=1 
» 220 T s0*, 
1+4 
das = 7 ES ad 300600). =2 e memel 


Asymptote intersection (Rule 6) 


A o 
¡ 3-0 


Ta = -2.33 


Characteristic equation: From equation (5.24) 


K 
oi 
or 
sis +2ls+5+K=0 


giving 


*+7+108+K=0 


Breakaway points (Rule 8) 


(5.63) 


(5.64) 


(5.65) 


(5.66) 


(5.67) 


(5.68) 


(5.69) 


Method (a): Re-arrange the characteristic equation (5.69) to make K the subject 


K=-s — 75 — 105 


Multiplying through by —1 
35? + 1454 10=0 


—14 + y 142 — 120 
6 


$1, $2 =04 = 


0% = 3.79, —0.884 


(5.70) 


(5.71) 


(5.72) 


(5.73) 
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Method (b) 
AA eu 
Multiplying through by, 
opl[or + 2)(09 + 5) 
(0% + 204 + 5) + Oplop +5) + 0p(0p +2) =0 
(5.75) 
R+T0+10+ 01 +5S0+0%+20p =0 
307 + 140 + 10=0 
or = 3.79, — 0.884 (5.76) 


Note that equations (5.72) and (5.75) are identical, and therefore give the same roots. 
The first root, —3.79 lies at a point where there are an even number of open-loop poles to 
the right, and therefore is not valid. The second root, —0.884 has odd open-loop poles to 
the right, and is valid. In general, method (a) requires less computation than method (b). 


Imaginary axis crossover (Rule 9) 
Method (a) (Routh-Hurwitz) 


o K 

s! (70 — K)y/7 

e 7 K 
5 1 10 


From Routh's array, marginal stability occurs at K = 70. 


Method (b): Substitute s= jw into characteristic equation. From characteristic 
equation (5.69) 


(ju? + Tjwy? + 10) + K =0 


— ju — 7 + 1Ojw+K=0 (5.77) 
Equating imaginary parts gives 
=w* + 10w=0 
w=10 
w=-+3.16 rad/s (5.78) 
Equating real parts gives 
1 +K=0 
8:K=7w%*=70 (5.79) 


Note that method (b) provides both the crossover value (i.e. the frequency of 
oscillation at marginal stability) and the open-loop gain constant. 
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K 


ARE s(s+2)(s+5) 


A cai SÓN: 


Imaginary Axis 
o 
A 
X 


2 


—3F 


A 1 ] ] ] 1 1 ] 
9 8 7 6 5 4 3 2 


Real Axis 


Fig. 5.14 Sketch of root-locus diagram for Example 5.8. 


The root locus diagram is shown in Figure 5.14. 
Part (b) From equation (5.52), line of constant damping ratio 1s 
fB = cos (C) =cos”*(0.5) = 60? (5.80) 


This line is plotted on Figure 5.14 and trial points along it tested using the angle 
criterion, i.e. 

01 + 02 +03 = 180? 

At s = -0.7+31.25 (5.81) 

120 + 44 + 16 = 180* (5.82) 
Hence point lies on the locus. 


Value of open-loop gain constant K: Applying the magnitude criterion to the above 
point 
K = lal|b|c] 
=1.4x1.8x4.5= 11.35 (5.83) 
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Fig. 5.15 Determination of real closed-loop pole. 


Closed-loop poles (For K = 11.35): Since the closed-loop system is third-order, there 
are three closed-loop poles. Two of them are given in equation (5.81). The third lies 
on the real locus that extends from —5 to —oo. Its value is calculated using the 
magnitude criterion as shown in Figure 5.15. 

From Figure 5.15 


xx + 2) + 5) = 11.35 (5.84) 


Substituting x = 0.73 (1.e. s; = —5.73) in equation (5.84) provides a solution. Hence 
the closed-loop poles for K = 11.35 are 


s =-5.713, -0.7+31.25 (5.85) 


Example 5.9 (See also Appendix 1, examp539.m) 
The open-loop transfer function for a control system 1s 


G(s)H(s) = s(s? +45 + 13) 


Find the asymptotes and angles of departure and hence sketch the root locus 
diagram. Locate a point on the complex locus that corresponds to a damping ratio 
of 0.25 and hence find 


(a) the value of K at this point 
(b) the value of K for marginal stability 


Solution 
Open-loop poles: s=0, 


-4+Y16- 52 


Open-loop zeros: None m=0 


Classical design in the s-plane 


Asymptote angles (Rule 5) 
(140) 7 


0 -=60. k= 8 
¡CI 600, 40 (5.86) 
O AA O (5.87) 
550 
(0d+47 57 A 
3 30 3 3009, , n—-m (5.88) 


Asymptote intersection (Rule 6) 


o. =10+ (2413) + (22-534 -0 


3 (5.89) 
da = —1.333 (5.90) 
Characteristic equation 
+4+133+K=0 (5.91) 
Breakaway points: None, due to complex open-loop poles. 
Imaginary axis crossover (Rule 9) 
Method (b) 
GwyY + 4(Gwy + l3jw+K=0 
or 
ju? — 40? + 13jw+K=0 (5.92) 
Equating imaginary parts 
=P + 13w=0 
tw =13 
w= +3.6 rad/s (5.93) 
Equating real parts 
4 Yy K=0 
K= 52 (5.94) 


Angle of departure (Rule 10): If angle of departure is 04, then from Figure 5.16 


0, +00 +04 = 1800 
04 = 180 — 0, — 0, 
04 = 180 — 123 — 90 = -33* (5.95) 


Locate point that corresponds to ( = 0.25. From equation (5.52) 


fB=cos”! (0.25) = 75.5" (5.96) 
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4 T T T T T 
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G(s)H(s) =— 
s(s +45+13) 
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Fig. 5.16 Root locus diagram for Example 5.9. 


Plot line of constant damping ratio on Figure 5.16 and test trial points along it using 
angle criterion. 
Ats= —-0.8+]32.9 


104.5+79.5—4= 180" 


Hence point lies on locus. 
Applying magnitude criterion 


K=3.00x 6.0 x 1.25=22.5 (5.97) 


5.4 Design in the s-plane 


The root locus method provides a very powerful tool for control system design. The 
objective is to shape the loci so that closed-loop poles can be placed in the s-plane at 
positions that produce a transient response that meets a given performance specifica- 
tion. It should be noted that a root locus diagram does not provide information 
relating to steady-state response, so that steady-state errors may go undetected, 
unless checked by other means, 1.e. time response. 
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Table 5.2 Compensator characteristics 


Compensator Characteristics 


PD One additional zero 
PI One additional zero 

One additional pole at origin 
PID Two additional zeros 


One additional pole at origin 


5.4.1 Compensator design 


A compensator, or controller, placed in the forward path of a control system will 
modify the shape of the loci 1f it contains additional poles and zeros. Characteristics 
of conventional compensators are given in Table 5.2. 

In compensator design, hand calculation is cumbersome, and a suitable computer 
package, such as MATLAB is generally used. 


Case Study 


Example 5.10 (See also Appendix 1, examp510.m) 
A control system has the open-loop transfer function given in Example 5.8, 1.e. 
1 
GC(NH(S) ===» K=1 
A LA CTE E 


A PD compensator of the form 


G(s) = Ki(s +) (5.98) 
1s to be introduced in the forward path to achieve a performance specification 


Overshoot less than 5% 
Settling time (+2%) less than 2 seconds 


Determine the values of K¡ and a to meet the specification. 


Original controller 

The original controller may be considered to be a proportional controller of gain Kand the 
root locus diagram is shown in Figure 5.14. The selected value of K = 11.35 is for a 
damping ratio of 0.5 which has an overshoot of 16.3% in the time domain and is not 
acceptable. With a dampingratio of0.7 the overshootis4.6% whichis within specification. 
This corresponds to a controller gain of 7.13. The resulting time response for the original 
system (K= 11.35) is shown in Figure 5.20 where the settling time can be seen to be 5.4 
seconds, which is outside of the specification. This also applies to the condition K=7.13. 


PD compensator design 

With the PD compensator of the form given in equation (5.98), the control problem, 
with reference, to Figure 5.14, is where to place the zero a on the real axis. Potential 
locations include: 


(1) Between the poles s = 0, —2, 1.e. ats=—1 
(11) At s = —2 (pole/zero cancellation) 
(111) Between the poles s =—2,—5, 1.e ats = —3 
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Fig. 5.17 Root locus diagram for compensator K+ (s + 1). 
Option 1 (zero positioned at s =—1): The cascaded compensator and plant transfer 
function become 
Ki(s+ 1) 
G(NH(S) = += 5.99 
(JA) sís + 2)(s + 5) ( ) 
The root locus diagram is shown in Figure 5.17. 
It can be seen in Figure 5.17 that the pole at the origin and the zero at s =-—1 


dominate the response. With the complex loci, (=0.7 gives K¡ a value of 15. 
However, this value of K¡ occurs at —0.74 on the dominant real locus. The time 
response shown in Figure 5.20 shows the dominant first-order response with the 
oscillatory second-order response superimposed. The settling time is 3.9 seconds, 
which is outside of the specification. 


Option 2: (zero positioned at s = —2): The cascaded compensator and plant transfer 
function 1s 


Ki¡(s +2) 
sís + 2)(s + 5) 


The root locus diagram is shown in Figure 5.18. The pole/zero cancellation may be 
considered as a locus that starts at s =—2 and finishes at s = —2, 1.e. a point on 
the diagram. The remaining loci breakaway at s = —2.49 and look similar to the 
second-order system shown in Figure 5.9. The compensator gain K, that corresponds 
to (=0.7 is 12.8. The resulting time response is shown in Figure 5.20 and has an 
overshoot of 4.1% and a settling time of 1.7 seconds, which is within specification. 


G(s)H(s) = (5.100) 
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Fig. 5.18 Root locus diagram for compensator K+1 (s + 2). 
Option 3: (zero positioned at s = —3): The cascaded compensator and plant transfer 
function is 
K; (s + 3) 


G(s)H(s) = (5.101) 


sís + 25 + 5) 
The root locus diagram is shown in Figure 5.19. In this case the real locus occurs 
between s = —5 and —3 and the complex dominant loci breakaway at op = —1.15. 
Since these loci are further to the right than the previous option, the transient 
response will be slower. The compensator gain that corresponds to (=0.7 1s 
K¡ = 5.3. The resulting time response is shown in Figure 5.20, where the overshoot 
1s 5.3% and the settling time is 3.1 seconds. 


Summary: Of the three compensators considered, only option 2 met the performance 
specification. The recommended compensator is therefore 


G(s) = 12.8(s + 2) (5.102) 


Case study 
Example 5.11 (See also Appendix 1, examp511.m) 
A ship roll stabilization system 1s shown in Figure 5.21. The system parameters are 


Fin time constant Tf = 1.0seconds 


Ship roll natural frequency w, = 1.414 rad/s 
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Fig. 5.19 Root locus diagram for compensator K+ (s + 3). 
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Fig. 5.20 Time response for the three options considered. 
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Fig. 5.21 Ship roll stabilization system. 


Ship roll damping ratio  (= 0.248 
Ship steady-state gain K;,= 0.5 


Performance specification 


Without stabilization, the step response of the roll dynamics produces a 45% over- 
shoot and a settling time of 10 seconds. The stabilization control system is required to 
provide a step response with an overshoot of less than 25%, a settling time of less 


than 2 seconds, and zero steady-state error. 


(a) Proportional control: With a proportional gain K¡, the open-loop transfer 


function is 


K Ku? 
G(sSH(s) = n 5.103 
CHO= TE + 20 +07) ne) 
Inserting values 
K 
G(SH(s) = 5.104 
OO0= EFD ads 
where 
K = K¡Ksw? (5.105) 
Open-loop poles: s=-—1,-—0.35+3]1.37 n=3 
Open-loop zeros: None m=0 
Asymptote angles (Rule 5) 
d+-07 7 
0, = =>=60 k= .1 
1 50 3 607, 0 (5.106) 
14+2 
A A (5.107) 
3-0 
(+4) 57 
0 = | =>=300 k=2 5.108 
TS da 
Asymptote intersection (Rule 6) 
—-1 0.35 431.37 0.35 —31.37 0 
O A +31.37) +( 31.37) (5.109) 


3-0 
Ta = —0.57 


(5.110) 
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Characteristic equation 


Mara 610 
giving 
*+17%+2.754+(Q+XK)=0 (5.112) 
Breakaway points: None 
Imaginary axis crossover (Rule 9) 
From characteristic equation (5.112) 
Gu + 1.70? +2.760)+(Q+K)=0 
ja? — 1.702 +2. Tjw0+(0+K)=0 
Equating imaginary parts 
7 + 2.1 =0 
we =2.7 
w= +1.643 rad/s (5.113) 
Equating real parts 
-1.12+(Q+K)=0 
K=1.7%?-2=2.59 (5.114) 


The root locus diagram is shown in Figure 5.22. It can be seen that proportional 
control is not appropriate since as the controller gain K; is increased the complex loci 
head towards the imaginary axis, making the response even more oscillatory than the 
open-loop response, until at K=2.59 (K, = 2.59) the system becomes unstable. 
Also, since no pure integrator is present in the control loop, there will be significant 
steady-state errors. 


(b) PID control: In order to achieve an acceptable response, the complex loci need 
to be attracted into the left-hand-side of the s-plane. This might be achieved by 
placing a pair of complex zeros to the left of the open-loop poles. In addition, a pure 
integrator needs to be introduced. This points to a PID controller of the form 


Ki(s +b 
G(s) = E (5.115) 
putting b= 4 and c=8 gives a pair of complex zeros 
s=-2+ 32 
The open-loop transfer function now becomes 
K(s? + 4s +8 
G(5)H(s) = PORO) (5.116) 


s(s + 1)J(s? + 0.75 + 2) 


The root locus diagram is shown in Figure 5.23. The control strategy however, 
has not worked. The pure integrator and the open-loop pole s= —1 produce a 
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Fig. 5.22 Proportional control, ship roll stabilization system. 
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Fig. 5.23 PID control, ship roll stabilization system. 
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Fig. 5.24 PIDD control, ship roll stabilization system. 


breakaway point at s = —0.6. This in turn creates a second pair of complex loci that 
terminate at the new open-loop zeros, leaving the original complex loci to crossover 
the imaginary axis as before. 


(c) PIDD control: If an additional open-loop zero is placed on the real axis, to the 
left of the open-loop pole s = —1, a further breakaway point will occur to the left of 
the new zero. This should have the effect of bringing one pair of complex loci back to 
the real axis, whilst allowing the original complex loci to terminate at the complex 
open-loop zeros. If a new real zero is placed at s= —2, the open-loop transfer 
function becomes 
K(s + 25? + 4s + 8) 
s(s + 1)(52 + 0.75 +2) 


The resulting root-locus diagram is shown in Figure 5.24. 

The control strategy for the root-locus diagram shown in Figure 5.24 is called 
PIDD, because of the additional open-loop zero. The system is unstable between 
K =0.17 and K = 1.06, but exhibits good transient response at K = 10.2 on both 
complex loci. 

Figure 5.25 shows the step response for (a) the hull roll action without a stabilizer 
system, and (b) the hull roll action with a controller/compensator with a control law 


_ 10.2(s + 25? + 4s + 8) 
s 


G(5)H(s) = (5.117) 


G(s) 


(5.118) 
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Fig. 5.25 Ship hull step response with and without stabilizers system. 


System performance 
(1) Without stabilizer system 


Rise time (95%) 1.3 seconds 
Percentage Overshoot 45% 
Settling time (+2%) 10.0 seconds 


(11) With stabilizer system 


Rise time (95%) 0.14 seconds 
Percentage overshoot 22.8% 
Settling time (+2%)  1.4seconds 
With the stabilizer system, the step response meets the performance specification. 


5.5 Further problems 


Example 5.12 
Use the Routh-Hurwitz criterion to determine the number of roots with positive real 
parts in the following characteristic equations 


(a) +37 +68 +25+45=0 Ans: two 
(b) $ +25 +35 +45? +254+1=0 Ans: none 
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Example 5.13 
Find the value of the open-loop gain constant K to make the control system, whose 
open-loop transfer function is given below, just unstable. 


K 
SOHO = 1625 Ans: 72 


Example 5.14 
A feedback control system has the following open-loop transfer function 


K 

ARO ES 

(a) Sketch the root locus by obtaining asymptotes, breakaway point and imaginary 
axis cross-over point. 

(b) A compensating element having a transfer function G(s)= (s+ 2) is now 
included in the open-loop transfer function. If the breakaway point is —0.56, 
sketch the new root locus. Comment on stability of the system with, and without 
the compensator. 

(c) Demonstrate that for the compensated system the co-ordinates —2.375, 
—1.8 +34.0 lie on the curve. What is the value of K for these points? 


Solution 


(a) 04 =-—2, 0, = 0.47, w = +]2.24 rad/s 
(b) With compensator, system stable for all K 
(c) K= 23 


Example 5.15 
A feedback control system employing proportional control has the following open- 
loop transfer function 

K 


G(s)H(s) = (S+D(2+5+1) 


(a) Using asymptotes, sketch the root locus diagram for the closed-loop system and 

find 
(1) the angles of departure from any complex open-loop poles, 
(11) the frequency of transient oscillation at the onset of instability, 
(111) the value of K to give the dominant closed-loop poles a damping ratio [ of 
0.3 

(b) To improve the steady-state performance the proportional controller is replaced 
by a proportional plus integral controller. The forward-path transfer function 
now becomes 


K(s +2) 


CAEN AID 
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Demonstrate that 


(1) the two breakaway points occur at 


dr, = 0.623 
Op, = -2.53 
(11) the imaginary axis crossover occurs when K = 0.464 


Solution 
(a) (1) +30%, (11) 1.414 rad/s, (111) K = 0.55 


Example 5.16 


(a) The laser guided missile shown in Figure 5.26(a) has a pitch moment of inertia of 
90kgm?. The control fins produce a moment about the pitch mass centre of 
360 Nm per radian of fin angle 5. The fin positional control system has unity gain 
and possesses a time constant of 0.2 seconds. If all other aerodynamic effects are 
ignored, find the transfer functions of the control fins and missile (in pole-zero 
format) in the block diagram given in Figure 5.26(b). 

(b) You are to conduct a feasibility study to evaluate various forms of control 
action. Initially proportional control is to be considered. Using asymptotes only, 
construct the root locus diagram and give reasons why it would be unsuitable. 


Missile 
Controller Fin Dynamics Dynamics 


U(s) As) ; 
ASES ass Ha als Lu» Gs) a 


(b) 


Fig. 5.26 Laser guided missile. 
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(c) An open-loop zero is now introduced at s = —2. Again construct the root-locus 
diagram using asymptotes and comment on the suitability of the system. 

(d) Open-loop zeros at s = —2 and s = —3 are now introduced. Demonstrate that at 
s = —2,45 the complex loci join the real axis prior to terminating at the open- 
loop zeros. Show also that a trial point on the locus exists when jw = 1.45 and the 
damping ratio € = 0.7. Sketch the root locus diagram and evaluate the controller 
gain that corresponds to ( =0.7. 


Solution 


(a) Grs) =5/(s +5) Gx(s) = 4/5? 
(b) System unstable for all K 

(c) System stable for all K 

(d) Controller gain = 0.24 


Classical design in the 
frequency domain 


6.1 Frequency domain analysis 


Control system design in the frequency domain can be undertaken using a purely 
theoretical approach, or alternatively, using measurements taken from the compon- 
ents in the control loop. The technique allows transfer functions of both the system 
elements and the complete system to be estimated, and a suitable controller/compen- 
sator to be designed. 

Frequency domain analysis is concerned with the calculation or measurement of 
the steady-state system output when responding to a constant amplitude, variable 
frequency sinusoidal input. Steady-state errors, in terms of amplitude and phase 
relate directly to the dynamic characteristics, 1.e. the transfer function, of the system. 

Consider a harmonic input 


9(1) = A] sinwt (6.1) 
This can be expressed in complex exponential form 
0(1) = 404" (6.2) 
The steady-state response of a linear system will be 
Bo(+) = A2 Sin(wt — p) (6.3) 
or 
00(t) = AjeNei=o) (6.4) 


where ¿ is the phase relationship between the input and output sinewaves as shown in 
Figure 6.1. The amplitude ratio 42/41 is called the modulus and given the symbol |G|. 
Thus 


ÁA> 
=|G 6. 
7 | | ( 5) 


or 


42=A1|G| (6.6) 
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0i(t) 0i(t) = A, sin wét 


9o(t) = A2sin(wt—¿) 


1.52 


Fig. 6.1 Steady-state input and output sinusoidal response. 


Pa(w) 


Fig. 6.2 Harmonic response diagram. 
Substituting equation (6.6) into (6.3) 


00(1) = Ar |Glelu!=9 
= Ay |Gle dei (6.7) 
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0(0) = (410 Ge) 
= 0(0)/G|e + (6.8) 
Since |G| and ¿4 are functions of w, then equation (6.8) may be written 
Cu) = [Guo iA (6.9) 
i 


For a given value of w, equation (6.9) represents a point in complex space P(w). When 
wis varied from zero to Infinity, a locus will be generated in the complex space. This 
locus, shown in Figure 6.2, is in effect a polar plot, and is sometimes called a 
harmonic response diagram. An important feature of such a diagram is that its shape 
is uniquely related to the dynamic characteristics of the system. 


6.2 The complex frequency approach 


Relationship between s and jw. From equation (6.2) 


0(1) = 404" 
e = ju(A10*%) = jwb,(1) 
Taking Laplace transforms 
sO(s) = jw0¡(s) (6.10) 
or 
s= juw (6.11) 


Hence, for a sinusoidal input, the steady-state system response may be calculated by 
substituting s = jw Into the transfer function and using the laws of complex algebra 
to calculate the modulus and phase angle. 


6.2.1 Frequency response characteristics of first-order systems 


From equation (3.23) 


0 
s) = G(s) = 6.12 
1 0=6)=3 5 (6.12) 
For a sinusoidal input, substitute equation (6.11) into (6.12). 
d.,. z 
= :l 
7d) = Gi) =p (6.13) 


Rationalize, by multiplying numerator and denominator of equation (6.13) by the 
conjugate of (6.13), i.e. 


Le Jan 
M0 an 
_K(-—joT) 


FATE 5 
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Equation (6.14) is a complex quantity of the form a + jb where 
K 


Real part d= 130272 (6.15) 
y —KwT 
Imaginary part b= TFT (6.16) 


Hence equation (6.14) can be plotted in the complex space (Argand Diagram) to 
produce a harmonic response diagram as shown in Figure 6.3. 

In Figure 6.3 1t is convenient to use polar co-ordinates, as they are the modulus and 
phase angle as depicted in Figure 6.2. From Figure 6.3, the polar co-ordinates are 


[Guy] = Va? + db? 
A K Ñ —KwT N? (6.17) 
o 1 + 4272 1 +47? 


(6.18) 


which simplifies to give 


¡Gi = 

Ww)l = —==== 
! VI +wT?2 
Comparing equations (6.14) and (6.18), providing there are no zeros in the transfer 
function, it is generally true to say 


K 
G(juw)| = 6.19 
6! y Denominator of G(jw) ds 


N Re 


Fig. 6.3 A point in complex space for a first-order system. 
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(a) Polar Plot 


| Gli 0) ZG(jw) 
(degrees) 
K 0 


lts corbata sale 


-90 
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(b) Rectangular Plot (Frequency Response) 


Fig. 6.4 Graphical display of frequency domain data for a first-order system. 


Table 6.1 Modulus and phase for a first-order system 


w (rad/s) [G(jw)| /G(jw) (degrees) 
0 K —0 
YT K/y2 -45 
00 0 90 


The argument, or phase angle is 


/G(juw) = tan”! (2) (6.20) 
E 
-1 +42 72 
1+uw7? 


/G(jw) = tan” (—wT) (6.21) 


which gives 
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Using equations (6.18) and (6.21), values for the modulus and phase angle may be 
calculated as shown in Table 6.1. The results in Table 6.1 may be represented as a 
Polar Plot, Figure 6.4(a) or as a rectangular plot, Figures 6.4(b) and (c). Since the 
rectangular plots show the system response as a function of frequency, they are 
usually referred to as frequency response diagrams. 


6.2.2 Frequency response characteristics of second-order 


systems 
From equation (3.42) the standard form of transfer function for a second-order 
system 1s 
K 
G(S) = ==55— 6.22 
65) 294541 0) 
Substituting s =jw j 
K 
G(ju) =3 7 , (6.23) 
Gor + ¿(w) +1 
or 
: K 
G(jw) = a (6.24) 
U- Eta) 
Rationalizing gives 
2 
(ba) 
G(juw) = 27 , (6.25) 
(Ey +6) 
Using equations (6.17) and (6.19), the modulus is 
; K 
[(Gi)| = . (6.26) 
2 2 
(era) 
And from equation (6.20), the argument is 
AO 00, 
/G(Jw) = tan O (6.27) 


Table 6.2 Modulus and phase for a second-order system 


w (rad/s) |G(jw)| /G(juw) (degrees) 
0 K 0 
Un K/2€ 90 
00 0 —180 
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Re 


Fig. 6.5 Polar plot ofa second-order system. 


From equations (6.26) and (6.27) the modulus and phase may be calculated as shown 
in Table 6.2. The results in Table 6.2 are a function of € and may be represented as a 
Polar Plot, Figure 6.5, or by the frequency response diagrams given in Figure 6.6. 


6.3 The Bode diagram 


The Bode diagram is a logarithmic version of the frequency response diagrams 
illustrated in Figures 6.4(b) and (c), and also Figure 6.6, and consists of 

(1) a log modus-log frequency plot 

(11) a linear phase-log frequency plot. 

The technique uses asymptotes to quickly construct frequency response diagrams by 
hand. The construction of diagrams for high-order systems is achieved by simple 


graphical addition of the individual diagrams of the separate elements in the system. 
The modulus is plotted on a linear y-axis scale in deciBels, where 


[G(jw)| dB = 20 108, |G(jw)| (6.28) 


The frequency is plotted on a logarithmic x-axis scale. 
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Fig. 6.6 Frequency response diagrams for a second-order system. 


6.3.1 Summation of system elements on a Bode diagram 
Consider two elements in cascade as shown in Figure 6.7. 
Gi(ju) = |G1(jw)|ei (6.29) 
Gr(ju) = [GA jw)jei? (6.30) 
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RA) ——>  Guljw) GaliwW) | ——>» Clju) 


Fig. 6.7 Summation of two elements in cascade. 


(de) = Grid Gi 


= |G (j)GAjwyeió+A (6.31) 
Hence 
Gn , , 
Go] IGG 
or 
Era . . 
q 4) dB = 20108, [E (jw)| + 20 108 ¡y [G2(jw)| (6.32) 
and 
Cas . . 
¿Uu) = b1 + d2 = /Gi(jw) + ¿Gal ju) (6.33) 


In general, the complete system frequency response is obtained by summation of the 
log modulus of the system elements, and also summation of the phase of the system 
elements. 


6.3.2 Asymptotic approximation on Bode diagrams 


(a) First-order lag systems 

These are conventional first-order systems where the phase of the output lags behind 

the phase of the input. 

(1) Log modulus plot: This consists of a low-frequency asymptote and a high- 
frequency asymptote, which are obtained from equation (6.18). 


Low frequency (LF) asymptote: When w-= 0, |G(jw)J] — K. Hence the LF 
asymptote is a horizontal line at KdB. 

High frequency (HF) asymptote: When w > 1/T, equation (6.18) approximates 
to 


|G(jw)| = > (6.34) 


As can be seen from equation (6.34), each time the frequency doubles (an increase of 
one octave) the modulus halves, or falls by 6dB. Or alternatively, each time the 
frequency increases by a factor of 10 (decade), the modulus falls by 10, or 20 dB. 
Hence the HF asymptote for a first-order system has a slope which can be expressed 
as —6dB per octave, or —20dB per decade. 
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From equation (6.34), when w= 1/T', the HF asymptote has a value of K. Hence 
the asymptotes intersect at w= 1/T rad/s. Also at this frequency, from equation 
(6.18) the exact modulus has a value 


. K 
[G(jw)| =7 


Since 1/,/2 is —3dB, the exact modulus passes 3 dB below the asymptote intersection 
at 1/T rad/s. The asymptotic construction of the log modulus Bode plot for a first- 
order system is shown in Figure 6.8. 


1G (jul 
dB 


LF Asymptote 


A HF Asymptote 

u —6dB/octave 

u (+20dB/decade) 
Xx 


A log w 
7 


Fig. 6.8 Bode modulus construction for a first-order system. 
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Fig. 6.9 Bode phase construction for a first-order system. 
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(11) Phase plot: This has three asymptotes 


e A LF horizontal asymptote at 0? 

e A HF horizontal asymptote at —90* 

e A Mid-Frequency (MF) asymptote that intersects the LF asymptote at 1/107 
and the HF asymptote at 10/T (i.e. a decade either side of 1/T). 


The Bode phase plot for a first-order system is given in Figure 6.9. 


(b) First-order lead systems 
These are first-order systems where the phase of the output (in steady-state) leads the 
phase of the input. The transfer function of a first-order lead system is 


G(s) = K(1 + T5) (6.35) 

and 
[G(jw)]| = KV 1 +u?T? (6.36) 
/G(juw) = tan UwT) (6.37) 


The Bode diagram, given in Figure 6.10, is the mirror image, about the frequency 
axis, of the first-order lag system. Note that the transfer function given in equation 
(6.35) is also that of a PD controller. 


(c) Second-order systems 
(1) Log modulus plot 


LF asymptote: A horizontal line at KdB 
HF asymptote: When w > wn, equation (6.26) approximates to 


K 
( 


From equation (6.38), an octave increase in frequency will reduce the modulus by 
a quarter, or —12dB and a decade frequency increase will reduce the modulus 
by a factor of 100, or —40dB. Hence the HF asymptote for a second-order system 
has a slope of —12dB/octave or —40dB/decade. The LF and HF asymptotes inter- 
sect at w = w. Also at w,, the exact value of modulus from equation (6.26) is 


[G(juw)| = 


(6.38) 


(Go) => 


The value of the modulus relative to the LF asymptote is 


IG(jw)|dB = 20log;0 (E =) = 2010810 (7) (6.39) 
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Fig. 6.10 Bode gain and phase for a first-order lead system. 


Hence 
(= 0.25, Relative modulus = +6dB 
(=0.5, Relative modulus = 0dB 
(= 1.0, Relative modulus = —6dB 


(11) Phase plot: This has two asymptotes: 


e A LF horizontal asymptote at 0* 
e A HF horizontal asymptote at —180". 


The phase curve passes through —90* at w = wy. Its shape depends upon (€ and is 
obtained from the standard curves given in Figure 6.11. 
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Fig. 6.11 Bode gain and phase for a second-order system. 
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(d) A pure integrator 
Consider a pure integrator of the form 


K 
Gs) = E (6.40) 
now 
G(jw) = . 
(10) 0+]juw 
Rationalizing 
; K(0 — juw 
G(jw) = DS se. ) (6.41) 
[09 
From equation (6.17) 
A Ku? K 
[GGw)| =1/0+ === (6.42) 
w (09) 
and from equation (6.20) 
: —Kw/u* 
/G(jw) = tan”! (EE) = tan"! (—00) = -90* (6.43) 


It can be seen from equation (6.42) that the modulus will halve in value each time the 
frequency is doubled, ¡.e. it has a slope of —6dB/octave (—20 dB/decade) over the 
complete frequency range. 

Note that 


IG(ju)] =KdB whenuw= 1 
[G(ju) =1=0dB when w= K 


The Bode diagram for a pure integrator is shown in Figure 6.12. 


ZG(jw) 
—6 dB/octave 


Kek==-=-=-> (de rees) o 
(20 dB/decade) Y 


90 


l 
l 
l 
l 
l 
l 
l 
l 
1.0 K logw loguw 


Fig. 6.12 Bode diagram for a pure integrator. 
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Example 6.1 (See also Appendix 1, exampó61.m) 
Construct, using asymptotes, the Bode diagram for 


2 
G(S) = += 
(5) 1 +0.5s 
Low Frequency asymptote is a horizontal line at KdB, 
Le. +6dB 


(6.44) 


Asymptote intersection (break frequency) occurs at 1/T, 1.e. 2rad/s. The Bode 


diagram is shown in Figure 6.13. 


-6 dB/octave 


(o) 
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(b) Bode Phase 


Fig. 6.13 Bode diagram for G(s) = 2/1 + 0.5s. 
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Example 6.2 (See also Appendix 1, examp62.m) 
Draw the Bode diagram for 


4 


5) = 0252702571 


(6.45) 


IG(jw)l 


20 


10% 


w (rad/s) 


107 100 2 10 


(a) Bode Gain 
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Fig. 6.14 Bode diagram for a second-order system, K = 4, wn = 2, (= 0,2. 
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Comparing equation (6.45) with the standard form given in (6.22) 


1 
wd 


1.8. y =2rad/s 


5-03 
Un 
e fdo 


Low Frequency asymptote is a horizontal line at KdB 
Le. 20 log¡p (4) = +12dB 


The log modulus relative to the LF asymptote at w= w, is given by equation (6.39) 
1 
G(] =201 — | =8dB 
| Gol, 0810 5 


(Hence the absolute log modulus at w= w, is 20dB). The Bode diagram is given by 
Figure 6.14. Note in Figure 6.14 that the phase curve was constructed by reading the 
phase from Figure 6.11(b), an octave either side of wr. 


Example 6.3 
Construct, on log-linear graph paper, using asymptotes, and validate using 
MATLAB or a similar tool, the Bode diagrams for 


0-5 
PES a +45) 
(c) G(s) = a => A Ss) 
(d) G(s) = — 


s(0.2552 + 0.15 + 1) 


6.4 Stability in the frequency domain 


6.4.1 Conformal mapping and Cauchy's theorem 


In Chapter 5 the stability of linear control systems were considered in the s-plane. 
Using a process of conformal transformation or mapping, it is possible to map a 
contour from one complex plane to another. It is therefore possible to transfer 
stability information from the s-plane to another complex plane, the F(s)-plane. 
The relationship between the contours in the two complex planes is given by 
Cauchy”s theorem, which states: “For a given contour in the s-plane that encircles 
P poles and Z zeros of the function F(s) in a clockwise direction, the resulting 
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(a) s-plane (b) F(s)-plane 


Fig. 6.15 Mapping of a contour from the s-plane to the F(s)-plane. 


contour in the F(s)-plane encircles the origin a total of N times in a clockwise 


direction”. 
Where 
N=Z-P (6.46) 
Consider a function 
Hi AA (6.47) 
(s + pr)(s + p2) 
where z, and z, are zeros of F(s) and p, and p, are poles. Equation (6.47) can be 


written as 

F(s) = |F(s|/F(s) 
The mapping of a contour from the s-plane to the F(s)-plane is shown in Figure 6.15. 
From Figure 6.15 
la lb] 
[c||d| 


IF(s)| = (6.48) 


and 
LF(s) = 911 +02 — Óp1 — Óp2 (6.49) 
As s¡ in Figure 6.15(a) is swept clockwise around the contour, it encircles two zeros 


and one pole. From Cauchy's theorem given in equation (6.46), the number of 
clockwise encirclements of the origin in Figure 6.15(b) is 


N=ñ=l=1 (6.50) 


6.4.2 The Nyquist stability criterion 


A frequency domain stability criterion developed by Nyquist (1932) is based upon 
Cauchy”s theorem. If the function F(s) is in fact the characteristic equation of a 
closed-loop control system, then 
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F(s) = 1 + G(s)H(s) (6.51) 


Note that the roots of the characteristic equation are the closed-loop poles, which are 


the zeros of F(s). 


In order to encircle any poles or zeros of F(s) that lie in the right-hand side of the 
s-plane, a Nyquist contour is constructed as shown in Figure 6.16. To avoid poles at 
the origin, a small semicircle of radius e, where e —> 0, is included. 

Figure 6.17(a) shows the 1 + G(s)H(s) plane when Z-— P=2, 1.e. two clockwise 
encirclements. However, if the contour is plotted in G(s)H(s) plane as shown in 
Figure 6.17(b), then it moves one unit to the left, 1.e. encircles the —1 point. 


+jw 


Fig. 6.16 s-plane Nyquist contour. 


Im 


(a) 1+G(s)H(s) plane 


Fig. 6.17 Contours in the 1 + G(s)H(s) and G(s)H(s) planes. 


E e a 


(b) G(s)H(s) plane 
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The Nyquist stability criterion can be stated as: “A closed-loop control system is 
stable if, and only if, a contour in the G(s)H(s) plane describes a number of counter- 
clockwise encirclements of the (—1,]0) point, the number of encirclements being 
equal to the number of poles of G(s)H(s) with positive real parts”. 

Hence, because there is a net clockwise encirclement of the (—1, 30) point in Figure 
6.17(b) the system is unstable. If, however, there had been a net counter-clockwise 
encirclement, the system would have been stable, and the number of encirclements 
would have been equal to the number of poles of G(s)H(s) with positive real parts. 

For the condition P = 0, the Nyquist criterion is: *A closed-loop control system is 
stable if, and only if, a contour in the G(s)H(s) plane does not encircle the (—1, 30) 
point when the number of poles of G(s)H(s) in the right-hand s-plane is zero”. 

In practice, only the frequencies w= 0 to +00 are of interest and since in the 
frequency domain s = ju, a simplified Nyquist stability criterion, as shown in Figure 
6.18 is: “A closed-loop system is stable if, and only if, the locus of the G(jw)H(jw) 
function does not enclose the (—1, j0) point as w is varied from zero to infinity. 
Enclosing the (—1, jO) point may be interpreted as passing to the left of the point”. 
The G(jw)HA(jw) locus is referred to as the Nyquist Diagram. 

An important difference between analysis of stability in the s-plane and stability in 
the frequency domain is that, in the former, system models in the form of transfer 
functions need to be known. In the latter, however, either models or a set of 
input-output measured open-loop frequency response data from an unknown system 
may be employed. 


Margins of stability 
The closer the open-loop frequency response locus G(jw)H(jw) is to the (—1, 30) 


point, the nearer the closed-loop system is to instability. In practice, all control 


Im 


G(jw)H(jw) plane 


Stable 


Unstable 


Fig. 6.18 Nyquist diagram showing stable and unstable contours. 
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Fig. 6.19 Gain margin (GM) and phase margin (PM) on the Nyquist diagram. 
systems possess a Margin of Stability, generally referred to as gain and phase 
margins. These are shown in Figure 6.19. 


Gain Margin (GM): The gain margin is the increase in open-loop gain required 
when the open-loop phase is —180” to make the closed-loop system just unstable. 


Nyquist diagram 


1 
GM = >=; 73 (6.52) 
[GGeAGO! 
Bode diagram 
GM = 20lo A O Á (6.53) 
Sa] 


Phase Margin (PM): The phase margin is the change in open-loop phase, required 
when the open-loop modulus is unity, (or 0dB on the Bode diagram) to make the 
closed-loop system just unstable. 


Phase Margin = 180 — /G(ju)H(jw)Nmod = 1) (6.54) 
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Controller Plant 


5 K _— 
y ! s(s "+25 +4) 


Fig. 6.20 Closed-loop control system. 


Example 6.4 (See also Appendix 1, examp64.m) 
Construct the Nyquist diagram for the control system shown in Figure 6.20 and find 
the controller gain K; that 


(a) makes the system just unstable. (Confirm using the Routh stability criterion) 
(b) gives the system a gain margin of 2 (6dB). What is now the phase margin? 


Solution 
Open-loop transfer function 


K 
SH(s) = == E 
IAS s(s? + 25 +4) (6133) 
where 
K=4K; (6.56) 
K 
SH(S) = == 
Aa $ +25? + 45 
, E K 
G(jwyA (ju) = 
A 
K 
2? + ¡(dio — us) 
Rationalizing 
i K([-2u7 — j(4w — w*)) 
G(ju)H = 6.57 
MO ay (6.57) 
From equation (6.19) 
: ] K 
[¡G(ju)H(jw)| = (6.58) 
1/44 + (di — uy? 
From equation (6.20) 
z Ñ —(4w — w* 
/G(jw)H(jw) = tan”! EA 
2w* 
(6.59) 
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Table 6.3 Data for Nyquist diagram for system in Figure 6.20 


w (rad/s) 0.5 1.0 15 2.0 2.5 3.0 40 5.0 
IGUANHGAK=1) 0.515 0.278 0.191. 0.125 0.073 0.043 0.018 0.0085 
¿G(ju)H(jw) (deg) 105 124 150 180 204 220 236 245 


The Nyquist diagram is constructed, for K = 1, at frequencies either side of the 180? 
point, which, from equation (6.59) can be seen to be w= 2rad/s. Using equations 
(6.58) and (6.59), Table 6.3 may be evaluated. 


(a) From equation (6.52) 
GM = 1/0.125 =8 
Value of K to make system just unstable 
Kunstav = K +: GM 
=1x8=8 
From equation (6.56) 


K; for instability = 2 


(b) For a GM of 2, the locus must pass through the (—0.5, jO) point in Figure 6.21. 
This can be done by multiplying all the modulus values in Table 6.3 by four and 
re-drawing Figure 6.21. Alternatively, the scales of Figure 6.21 can be multiplied 
by a factor of four (without re-drawing). Hence the unit circle is 0.25 x 4 and the 
PM can be seen to have a value of 50” when the GM is 2.0. 


Value of K to give a GM of 2 is the original K times 4, 1.e. 1 x 4 = 4. From (6.56) 
Ki=1.0 
Hence, to give a GM of 2 and a PM of 50”, the controller gain must be set at 1.0. If it 


is doubled, i.e. multiplied by the GM, then the system just becomes unstable. Check 
using the Routh stability criterion: 


Characteristic equation 


1 s(s? E +4 9 (6.60) 

+2+454+K=0 (6.61) 
Routh's array 

| K 

s!| U8-—K) 

*12 K 

5d 10 4 


Thus when K > 8 then the system is unstable. 
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Fig. 6.21 Nyquist diagram for system in Figure 6.20. 


System type classification 


Closed-loop control systems are classified according to the number of pure integra- 
tions in the open-loop transfer function. If 


G(9H(s) = E ne - = (6.62) 


Then » in equation (6.62) is the “type number” of the system and [[ denotes the 
product of the factors. The system “type” can be observed from the starting point 
(w—= 0) of the Nyquist diagram, and the system order from the finishing point 
(w —= 00), see Figure 6.22. 


System *“type' and steady-state errors 


From the final value theorem given in equation (3.10) it is possible to define a set of 
steady-state error coefficients. 


1. Position error coefficient 


K, = lim G(s) 
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G(s)H(s) = XK 
s(1+T5) Im 
Im 
a K 
ASAS = 7,73 
Re 
Re 
(a) First-order type zero system (b) Second-order type one system 
Im 
K 
G(s a Re 
(As) s(1+Ts) 
(c) Third-order type two system 
Fig. 6.22 Relationship between system type classification and the Nyquist diagram. 
For a step input, 
1 
ls = 6.63 
==1x (6.63) 
2. Velocity error coefficient 
K, =lim s G(s) 
s>0 
For a ramp input, 
1 
€s = +7 6.64 
“== (6:64) 
3. Acceleration error coefficient 
Ka =lim s? G(s) 
s=>0 
For a parabolic input, 
1 
€s == (6.65) 
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Table 6.4 Relationship between input function, system 
type and steady-state error 


Input function Steady-state error 


Type zero Type one Type two 


Step constant zero zero 
Ramp increasing constant zero 
Parabolic increasing increasing constant 


Table 6.4 shows the relationship between input function, system type and steady- 
state error. From Table 6.4 it might appear that it would be desirable to make most 
systems type two. It should be noted from Figure 6.22(c) that type two systems are 
unstable for all values of K, and will require some form of compensation (see 
Example 6.6). 

In general, type zero are unsatisfactory unless the open-loop gain K can be raised, 
without instability, to a sufficiently high value to make 1/(1 + K,) acceptably small. 
Most control systems are type one, the integrator either occurring naturally, or 
deliberately included in the form of integral control action, i.e. PI or PID. 


Stability on the Bode diagram 
In general, it is more convenient to use the Bode diagram in control system design 
rather than the Nyquist diagram. This is because changes in open-loop gain do not 
affect the Bode phase diagram at all, and result in the Bode gain diagram retaining its 
shape, but just being shifted in the y-direction. 

With Example 6.4 (see also Appendix 1, examp64a.m and examp64b.m), when the 
controller gain set to K; = 1.0, the open-loop transfer function is 


G(SH(s) = (6.66) 


s(s? + 2s +4) 


Equation (6.66) represents a pure integrator and a second-order system of the form 


1 1 
s)H(s) = 
COMO aa +055+ 1) 


(6.67) 


As explained in Figure 6.12 the pure integrator asymptote will pass through 0dB at 
l.Orad/s (for K=1 in equation (6.67)) and the second-order element has an 
undamped natural frequency of 2.0 rad/s and a damping ratio of 0.5. 

Figure 6.23(a), curve (1), shows the Bode gain diagram for the transfer function 
given in equation (6.66), which has a gain margin of 6 dB (the amount the open-loop 
gain has to be increased to make the system just unstable. Figure 6.23(a), curve (11), 
shows the effect of increasing K by a factor of two (6dB) to make the system just 
unstable. For curve (11) the open-loop transfer function is 


8 


G(SH(s) = SERRA 


(6.68) 


Figure 6.23(b) shows the Bode phase diagram which is asymptotic to —90* at low 
frequencies and —270* at high frequencies, passing through —180? at 2rad/s. To 
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determine the phase margin, obtain the open-loop phase when the modulus is O0dB 


(on curve (1), Figure 6.23(a), this is approximately 1.1 rad/s), and subtract the phase 
from 180? to give a PM of 50” as shown. 
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Fig. 6.23 Stability on the Bode diagram. 
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6.5 Relationship between open-loop and closed-loop 
frequency response 


6.5.1 Closed-loop frequency response 


When designing a control system it is essential to 


(a) ensure that the system is stable for all operating regimes 
(b) ensure that the closed-loop performance meets the required specification. 


Time domain performance specifications are described in section 3.7 and Figure 3.21. 
Frequency domain performance specifications are given in terms of gain and phase 
margins to provide adequate stability together with information relating to the 
closed-loop frequency response. Figure 6.24 shows the closed-loop frequency 
response of a control system. The closed-loop modulus is usually defined as 


E. 
Z ¡9 =M (6.69) 


Bandwidth (y): This is the frequency at which the closed-loop modulus M has fallen 
by 3dB below its zero frequency value. (This is not true for systems that do not 
operate down to dc levels.) 


Peak modulus (M,): This is the maximum value that the closed-loop modulus M 
rises above its zero frequency value. 


Peak frequency (Wp): This is the frequency that the peak modulus occurs. Note that 
Wp < UB. 


Second-order system closed-loop frequency response 
Many closed-loop systems approximate to second-order systems. Equation (6.26) 
gives the general equation for modulus. If, when K' is set to unity, this equation is 


Ci ) 
5 ) Mo 
M 
(Mm, 
(dB) 3 y======— — O 
Bandwidth 
l 
l 
Wo We log w (rad/s) 


Fig. 6.24 Closed-loop frequency response. 
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squared, differentiated with respect to w? and equated to zero (to find a maximum), 
then 


1 
M,= Na (6.70) 
dp = wn y 1 — 20? (6.71) 


If, as a rule-of-thumb, M, is limited to 3dB (V2), then from equations (6.70), (6.71) 
and Figure 6.11 


(= 0.38 
Wp = 0.840 (6.72) 
wp = 1.40, 


In general, for a unity feedback control system, the closed-loop frequency response 1s 
given by equation (6.73) 


Cas G(jw) 
= - 7 
RU 1 + G(ju) (6-12) 
Equation (6.73) can be expressed in rectangular co-ordinates as 
co: X(jw) + Y Gu) 
= , ; 6.74 
RIDE TX GO +3YG) ii 
Hence 
dr. X(jw) +/Y(j)| 
(ju) = M = ASS 6.75 
70 ) 11 +XGu) +jYGu)| e 
Equation (6.75) can be expressed as an equation of a circle of the form 
MENE oe MW 
1.e. 
(> 
centre 0) 
y — > 
dd (6.77) 
radius + nal 
XAM?2—1 
Also, from equation (6.73) 
Co, , , h . 
¿UN = 4400) + FG) — 44 + X(u) + Y Gu) (6.78) 


let 


N= tan ¿Go | (6.79) 
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Equation (6.78) can also be expressed as an equation of a circle of the form 


O SS 5 
(xo +3) +(160-55) (52) (6.50) 
1.e. 
centre —1/2, 1/2N 
VNF 1 (6.81) 
radius =aN 7 


The M and N circles can be superimposed on a Nyquist diagram (called a Hall chart) 
to directly obtain closed-loop frequency response information. 

Alternatively, the closed-loop frequency response can be obtained from a Nyquist 
diagram using the direct construction method shown in Figure 6.25. From equation 


(6.73) 
C.. [EG  _ |OBI 
Le = A _= 6.82 
260 Gaia is 
Also from equation (6.73) 
Co, ; y 
15 =/G =N01+G 
gu) (Ju) — A1+ Gu) (6.83) 
= /COB — /OAB 
Im 
C 
1 Re 


Fig. 6.25 Closed-loop frequency response from Nyquist diagram using the direct construction method. 
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Fig. 6.26 The Nichols chart. 


Hence 


E ju) = —/ABO (6.84) 


The Nichols chart 

The Nichols chart shown in Figure 6.26 is a rectangular plot of open-loop phase on 
the x-axis against open-loop modulus (dB) on the y-axis. M and N contours are 
superimposed so that open-loop and closed-loop frequency response characteristics 
can be evaluated simultaneously. Like the Bode diagram, the effect of increasing the 
open-loop gain constant K is to move the open-loop frequency response locus in the 
y-direction. The Nichols chart is one of the most useful tools in frequency domain 
analysis. 


Example 6.5 
For the control system given in Example 6.4, determine 


(a) The controller gain K| to give the best flatband response. What is the bandwidth, 
gain margin and phase margin? 

(b) The controller gain K¡ to give a peak modulus M, of 3dB. What is the band- 
width, gain margin and phase margin? 
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(c) For the controller gain in (b), what, in the time domain, is the rise-time, settling 
time and percentage overshoot? 


Solution 


(a) The open-loop transfer function for Example 6.4 is given by equation (6.55) 
K 


SOBMIS a 


(6.85) 
Figure 6.27 (see also Appendix 1, fig627.m) shows the Nichols chart for K =4 


(controller gain K¡ = 1). These are the settings shown in the Bode diagram in Figure 
6.23(a), curve (1), and (b), where 


Gain margin = 6dB 
Phase margin = 50? 
From Figure 6.27 it can be seen that the peak modulus M, is 4dB, occurring at 


wp = 1.63 rad/s. The bandwidth wg is 2.2 rad/s. For the best flatband response, the 
open-loop frequency response locus should follow the 0dB M contour for as wide 
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Fig. 6.27 Nichols chart for Example 6.5, K = 4, 
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Fig. 6.28 Nichols chart showing best flatband response (curve (a)) and response with M,=3dB (curve (b)). 


a frequency range as possible. This is shown in Figure 6.28, curve (a). To obtain curve 
(a), the locus has been moved down by 2dB from that shown in Figure 6.27. This 
represents a gain reduction of 


gain reduction factor = alog(—2/20) = 0.8 (6.86) 

Hence, for best flatband response 
K=4.0 x 0.8 = 3.2 (6.87) 
Controller gain K¡, = K/4 = 3.2/4 = 0.8 (6.88) 


From Nichols chart 


Gain margin = 8.15dB 
Phase margin = 607 (6.89) 
Bandwidth = 2.02 rad/s 


(b) To obtain curve (b), the locus has been moved down by 0.5dB from that shown 
in Figure 6.27. This represents a gain reduction of 


gain reduction factor = alog(—0.5/20) = 0.944 (6.90) 
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Fig. 6.29 Closed-loop frequency response showing best flatband response (curve (b)) and response with 
M¿=30B (curve (a)). 
Hence, for a peak modulus of M, = 3dB, 
K=4.0 x 0.944 = 3.8 (6.91) 
Controller gain K¡ = K/4= 3.8/4 = 0.95 (6.92) 
From Nichols chart 
Gain margin = 6.36dB 
Phase margin = 53" (6.93) 
Bandwidth = 2.1 rad/s 


Figure 6.29 (see also Appendix 1, f12629.m) shows the closed-loop modulus frequency 
response. Curve (a) is the best flatband response, curve (b) is the response with M, set 
to 3dB. 


6.6 Compensator design in the frequency domain 


In section 4.5, controllers, particularly PID controllers for closed-loop systems were 
discussed. In Chapter 5 it was demonstrated how compensators could be designed 
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in the s-plane to improve system performance. In a similar manner, it is possible 
to design compensators (that are usually introduced in the forward path) using 
frequency domain techniques. 

The general approach is to re-shape the open-loop frequency response locus 
G(jw)H(jw) in such a manner that the closed-loop frequency response meets a given 
frequency domain specification in terms of bandwidth and peak modulus. 


PD cascade compensation: In Chapter 5, case-study Example 5.10, it was demon- 
strated how a cascaded PD compensator could improve both system performance 
and stability. However, in this chapter, Figure 6.10 gives the frequency response 
characteristics of a PD controller/compensator. The important thing to note about 
Figure 6.10 is that, in theory, above w=1/T, the log modulus increases at 
+6dB/octave for evermore. In practice this will not happen because eventually 
system elements will saturate. But what will happen, however, is that any high 
frequency noise in the system will be greatly amplified. It therefore becomes neces- 
sary, in a practical application, both with PD and PID controllers, to introduce, at 
some suitable high frequency, a low-pass filter. 


6.6.1 Phase lead compensation 


A phase lead compensator is different from the first-order lead system given in 
equation (6.35) and Figure 6.10 because it contains both numerator and denominator 
first-order transfer functions. 


(a) Passive lead compensation 
A passive lead network (using two resistors and one capacitor) has a transfer func- 
tion of the form 

1 (1+aT5) 


There are two disadvantages of passive lead compensation: 


(1) the time constants are linked 

(11) the gain constant 1/a is always less than unity (called insertion loss) and addi- 
tional amplification of value a, is required to maintain the value of the open-loop 
gain K. 


(b) Active lead compensation 
An active lead compensation network is shown in Figure 6.30. For an inverting 
Operational amplifier 
Vo Zi 
A 9 
YA (s) Z; (6.95) 
where Z; = input impedance and Zf = feedback impedance. 
Now 
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Fig. 6.30 Active lead compensation network. 
Hence 
Ri 
=> 6. 
1+R¡Cis 16:28) 
and 
R) 
Zhj== 6.97 
SIETE R>Cos ( ) 
Inserting equations (6.96) and (6.97) into (6.95) 
Vo —R) [1+R¡Cis 
s)= 6.98 
14 (s) Ri E e El ( ) 
or, in general 
1+ Tis 
G(s) = Kb 5 E) (6.99) 


Thus from equation (6.99) it can be seen that the system designer has complete 

flexibility since, K¡, 7, and T» are not linked. For a lead network, 7] must be greater 

than T,. The Bode diagram for an active lead network is shown in Figure 6.31. 
From equation (6.99) 


, ( mn K(1+]joT)YA — juT,) 
G =K - 6.100 
(1) de +juT») (1 +72) 000 
expanding 
; K( —juT, + JoT| + T¡ Tau?) 
G(jw) = (6.101) 
(1 +27?) 
glving 
; KO +71 T20%) + ju(T1 — Ta)) 
G(jw) = (6.102) 
(1473) 
From equation (6.20) 
aia ABD (6.103) 


(1 +7 T 20?) 
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Fig. 6.31 Frequency response characteristics of a lead compensator. 


To find wn, differentiate equation (6.103) with respect to w, and equate to zero. This 
gives 


AE (6.104) 
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Fig. 6.32 Relationship between /,, and the spacing of 1/7; and 1/T2 in octaves. 


Substituting equation (6.104) into (6.103) to give 


a TT) 
= tan 6.105 
óm = tan E E) (6.105) 
The value of fm depends upon the spacing of 1/7, and 1/7, on the log w axis, see 


Figure 6.32. 


Design procedure for lead compensation 

1. Set K to a suitable value so that any steady-state error criteria are met. 

2. Plot the open-loop frequency response and obtain the phase margin and the 
modulus crossover frequency. (1.e. the frequency at which the modulus passes 
through 0dB) 

3. Set 4 to the modulus crossover frequency and estimate the phase advance Qm 
required to provide a suitable phase margin. From equations (6.104) and (6.105), 
determine 7 and 7». 

4. Plot the compensated system open-loop frequency response. Note that the 
modulus crossover frequency has now increased. Reduce the compensator gain 
K¡ so that the modulus crossover frequency returns to its original value, and the 
desired phase margin is met. 


Case study 


Example 6.6 
The laser guided missile shown in Figure 5.26 has an open-loop transfer function 
(combining the fin dynamics and missile dynamics) of 


20 


G(sH(s) = FS 


(6.106) 
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Open-Loop Phase Gain (dB) 
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Fig. 6.33 Nichols chart for uncompensated laser guided missile. 


Design a cascade lead compensator that will ensure stability and provide a phase 
margin of at least 30%, a bandwidth greater than 5rad/s and a peak closed-loop 
modulus M, of less than 6 dB. 


Solution 

The open-loop transfer function is third-order type 2, and is unstable for all values of 
open-loop gain K, as can be seen from the Nichols chart in Figure 6.33. From Figure 
6.33 it can be seen that the zero modulus crossover occurs at a frequency of 1.9 rad/s, 
with a phase margin of —21”. A lead compensator should therefore have its max- 
imum phase advance Qm at this frequency. However, inserting the lead compensator 
in the loop will change (increase) the modulus crossover frequency. 


Lead compensator design one 

Place wm at the modulus crossover frequency of 2rad/s and position the compen- 
sator corner frequencies an octave below, and an octave above this frequency. Set 
the compensator gain to unity. Hence 


“Wm =2rad/s 1/T, =1rad/s 1/T,= 4rad/s 
K=1.0 Qm= 36.9" 
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Fig. 6.34 Nichols chart for lead compensator, design one. 


The compensator is therefore 


(1+s) 


A) = ad +0255 


(6.107) 


The Nichols chart for the uncompensated and compensated system (curve (a)) is shown 
in Figure 6.34 (see also Appendix 1, fig634.m). From Figure 6.34, curve (a) 


Gain margin = 2 dB 
Phase margin = 4” 
Modulus crossover frequency = 3.0 rad/s 


Figure 6.35 shows the Bode gain and phase for both compensated and uncompen- 
sated systems. From Figure 6.35, it can be seen that by reducing the open-loop gain 
by 5.4dB, the original modulus crossover frequency, where the phase advance is 


a maximum, can be attained. 


5.4 
20 ) = 0.537 


Gain reduction = ato 


(6.108) 
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Hence the lead compensator transfer function is 


0.537(1 + s) 


(1 + 0.255) ós 


G(s) = 


The open-loop frequency response contours for the compensator given in equation 
(6.109) are curves (b) in Figures 6.34 and 6.35 which produce 


Gain margin = 7dB 
Phase margin = 15? 


Modulus crossover frequency = 2 rad/s 
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Fig. 6.35 Bode gain and phase for lead compensator, design one. 
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Fig. 6.36 Closed-loop frequency response for lead compensator one. 


Figure 6.36 shows the closed-loop frequency response using lead compensator one 
and defined by equation (6.109) (modulus only). From Figure 6.36 


Peak modulus M, = 11.6dB 
Bandwidth = 3.4 rad/s 


This design does not meet the performance specification. 


Lead compensator design two 
From Figure 6.34 1t can be seen that to achieve the desired phase margin of at least 
30” then the compensator must provide in the order of an additional 20” of phase 
advance, i.e. 57” in total, at the modulus crossover frequency. 

From Figure 6.32, this suggests four octaves between the corner frequencies. Let 
1/T¡ remain at 1 rad/s and Position 1/7, at 16 rad/s (4 octaves higher). This provides 


Pm = 61.9" 
Wm = 4rad/s 
The design two compensator is therefore 


dw+s) 


(5%) = 0.0625) 


(6.110) 


The open-loop Bode gain and phase with the lead compensator given in equation 
(6.110) inserted in the control loop is shown in Figure 6.37. From Figure 6.37 curve (1) 
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it can be seen that the modulus crossover frequency is 3.37 rad/s, and the phase 
margin is (180 — 152.4), or 27.6?. This is close to, but does not quite achieve the 
specification. However, from Figure 6.37, the maximum phase advance of —145.3* 
occurs at 1.9 rad/s. At this frequency, the open-loop gain K'is 6.8 dB. Therefore, if the 
open-loop gain is reduced by this amount as shown in Figure 6.37, curve (11) then the 
modulus crossover frequency becomes 1.9rad/s and the phase margin is (180 — 
145.3), or 34.7”, which is within specification. The compensator gain K¡ therefore 
becomes 


K¡ = alog (55) = 0.457 (6.111) 
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Fig. 6.37 Open-loop bode gain and phase for design two lead compensator. 
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Fig. 6.38 Nichols chart for lead compensator design two. 


Figure 6.38, curve (a) shows the Nichols chart for the value of K¡ given in equation 
(6.111). It can be seen that M, = 5dB, but the bandwidth is 3.43 rad/s, which is 
outside of specification. However, because of the shape of the locus, it is possible to 
reduce the gain margin (18.6 dB in curve (a)) which will increase the bandwidth, but 
not significantly change the peak modulus, or the phase margin. Figure 6.38, curve 
(b) shows the open-loop gain K increased by 4.85dB. This now has a peak modulus 
of 5.5dB, a phase margin of 30.6” and a bandwidth of 5.09 rad/s, all of which are 
within specification. The new compensator gain K; is therefore 


4. 
K; =0.457 x alog (5) 


= 0.457 x 1.748 = 0.8 (6.112) 


The final lead compensator is 


0.8(1 + s) 


AS = 1000259) 


(6.113) 
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Fig. 6.39 Closed-loop frequency response for both lead compensator designs. 


System frequency domain performance 


Closed-loop peak M, = 5.5dB 
Gain margin = 13.75dB 
Bandwidth = 5.09 rad/s 
Phase margin = 30.6” 


Figure 6.39 shows, for both lead compensator designs, the closed-loop frequency 
response characteristics for the system. 


6.6.2 Phase lag compensation 


Using passive components, a phase lag compensator may be constructed, whose 
transfer function is of the form 
(1475) 
(1 +aTs) 
where a. is a number greater than unity. Passive lag networks suffer the same 
disadvantages of passive lead networks as discussed earlier. 

The active network shown in Figure 6.30 has the transfer function given in 
equation (6.99) 


G(s) = (6.114) 


Ki(1+7T15) 


Cd== + 


(6.115) 
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Fig. 6.40 Frequency response characteristics of a lag compensator. 


When T» is greater than 7 equation (6.115) is an active lag network, whose Bode 
diagram is shown in Figure 6.40. The relationships between 71, T>, Wim and $, are as 
given in equations (6.104) and (6.105), except, in this case, y. is negative. The same 
comment applies to Figure 6.32 which shows the relationship between the spacing of 
reciprocals of T, and T| and 0. 


Design procedure for lag compensation 


1. Set K to a suitable value so that any steady-state error criteria are met. 

2. Identify what modulus attenuation is required to provide an acceptable phase mar- 
gin and hence determine the spacing between 1/72 and 1/71 (¡.e. 6dB attenuation 
requires a one octave spacing, 12 dB attenuation needs a two octave spacing, etc.). 

3. Position 1/7, one decade below the compensated modulus crossover frequency, 
and hence calculate wm using equation (6.104). 

4. Adjust compensator gain K; if necessary. 
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Case study 


Example 6.7 
A process plant has an open-loop transfer function 


30 
COMO = aa 105 (6116) 


As it stands, when the loop is closed, the system is on the verge of instability, with a 
GM of 1.4dB, a PM of 4” and a modulus crossover frequency of 1.4rad/s. Reducing 
the open-loop gain K by 12dB (¡.e. K = 7.5) provides an acceptable GM of 13.5dB, 
PM of 52” with a modulus crossover frequency of 0.6rad/s. However, this gain 
setting produces an unacceptable step steady-state error of 12%. Design a lag 
compensator that maintains the open-loop gain K at 30, but provides gain and phase 
margins, similar to setting K at 7.5. What is now the steady-state step error? 


Solution 
Required modulus attenuation is 12dB. This reduces the modulus crossover fre- 
quency from 1.4 to 0.6 rad/s. 

Position 1/71 one decade below 0.6 rad/s 1.e. 0.06 rad/s. For a 12 dB attenuation, 
two octaves are required in the compensator, thus 1/7) is positioned at 0.015 rad/s. 
From equation (6.104) w, is 0.03 rad/s, and from equation (6.105) (using a negative 
value), fm = 36.9". 

Hence the required lag compensator is 


Ki(1 + 16.675) 


RT 


(6.117) 


The compensated and uncompensated open-loop frequency response is shown in 
Figure 6.41. From this Figure the compensated gain margin is 12.5dB, and the phase 
margin is 48”. In equation (6.117), K¡ does not need to be adjusted, and can be set to 
unity. When responding to a step input, the steady-state error is now 4.6%. 


6.7 Relationship between frequency response and time 
response for closed-loop systems 


There are a few obvious relationships between the frequency response and time 
response of closed-loop systems: 


(1) As bandwidth increases, the time response will be more rapid, i.e. the settling 
time will decrease. 

(11) The larger the closed-loop peak M,, the more oscillatory will be the time 
response. 
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Fig. 6.41 Lag compensated and uncompensated open-loop bode diagram for Example 6.7. 
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Since many closed-loop systems approximate to second-order systems, a few inter- 
esting observations can be made. For the case when the frequency domain specifica- 
tion has limited the value of M, to 3dB for a second-order system, then from 


equation (6.72) 


¿= 0.38 


Wp =0.84wW, (frequency that M, occurs) 
wp = 1.440, (bandwidth) 


(6.118) 
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Equation (3.73) gives the time for a second-order system to settle down to within a 


tolerance band of +2% 
1 
Í.= (2) ln 50 


or 
912 
=> - (6.119) 
Cn 
Inserting the values in equation (6.118) into equation (6.119) gives 
10.29 14.4 
a (6.120) 
Wn YB 


Thus the settling time is inversely proportional to the bandwidth. Comparing equa- 
tion (6.70) with equation (3.68) gives 


% overshoot =.e2%7%M x 100 (6.121) 


Hence a closed-loop system with an undamped natural frequency of 1.0rad/s and a 
damping ratio of 0.38 has the following performance: 


e Frequency domain 
M) (equation (6.70)) = 1.422 = 3.06 dB 
wy (equation (6.72)) = 1.4 rad/s. 


e Time domain 
t, (equation (6.120)) = 10.29 seconds 
% overshoot (equation (6.121)) = 27.5% 


6.8 Further problems 


Example 6.8 

A spring-mass—-damper system has a mass of 20 kg, a spring of stiffness 8000 N/m 
and a damper with a damping coefficient of 80 Ns/m. The system is excited by a 
constant amplitude harmonic forcing function of the form 


F(t) = 160 sin vt 


(a) Determine the system transfer function relating F(t) and x(t) and calculate values 
for ww and C. 

(b) What are the amplitudes of vibration when w has values of 1.0, 20 and 50 rad/s. 

(c) Find the value of the damping coefficient to give critical damping and hence, with 
this value, determine again the amplitudes of vibration for the angular frequen- 
cies specified in (b). 


Solution 

(a) wn = 20 rad/s, (=0.1 

(b) 0.02 m, 0.1 m and 0.0038 m 

(c) C = 800 Ns/m 0.02 m, 0.01 m and 0.0028 m 
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Example 6.9 
Construct, using asymptotes and standard second-order phase diagrams, the Bode 
diagrams for 


12 


WS 


(ii) Gs) = 


(0.0025 + 0.015 + 1) 
Gti) Gs) = a( LS ) 


1+0.55 


0.5 
s(s? + 0.55 + 1) 


When the loop is closed, will the system in (1v) be stable or unstable? 


(iv) G(SH(s) = 


Solution 
The system will have marginal stability. 


Example 6.10 
A control system has an open-loop transfer function 


K 


H(s) = 
G(s) (s) s(0.2552 + 0.255 + 1) 


Set K = 1 and plot the Nyquist diagram by calculating values of open-loop modulus 
and phase for angular frequency values from 0.8 to 3.0rad/s in increments of 
0.2 rad/s. Hence find the value of K to give a gain margin of 2 (6dB). What is the 
phase margin at this value of K? 


Solution 
K =0.5, Phase margin = 82” 


Example 6.11 
An open-loop frequency response test on an unknown system produced the following 
results: 


w (rad/s) 0.2 04 0.8 1.6 3.0 4.0 4.6 5 6 8 10 20 40 


IG(jwH(jo) (dB) 28 22 16 10.7 7.5 7.3 7.0 6.0 0.9 -—9.3 -28 -—36 —54 
/G(jw)H(jw) (deg)-91 -92 -—95 —100 —115 —138 —162 —180 -—217 -244 -—259-262-—266 


Plot the Bode diagram on log-linear paper and determine 


(a) The open-loop transfer function. 

(b) The open-loop gain constant K to give a gain margin of 4.4dB. What is the phase 
margin for this value of K? 

(c) The closed-loop transfer function (unity feedback) for the value of K found in (b). 

(d) The closed-loop peak modulus M, and bandwidth. 


Classical design in the frequency domain 195 


Table 6.5 Open-loop frequency response data 


w (rad/s) 0.1 0.3 0.7 1.0 1.5 2.0 3.0 5.0 10.0 
[GGw)H(Gw)]| (dB) 17 7 0.5 2 5 9 185 -33 Sl 
/G(jw)H(w) (deg) 92-98  -—112 123 150 180 220 224-258 
Solution 

5.0 


(a) G(5)H(s) = 


s(0.045? + 0.15 + 1) 
(b) K = 1.5, Phase margin = 79? 


37.5 


C(s)= 
5342.59 +255+37.5 


(o) 7 


(d) M, = 4.6dB, wg = 5.6 rad/s. 


Example 6.12 

(a) An open-loop frequency response test on a unity feedback control system pro- 
duced the data given in Table 6.5. Plot the Bode Diagram and determine the 
system open-loop and closed-loop transfer functions. What are the phase and 
gain margins? 


(b) A phase lead compensation network of the form 
_1(1+a75) 
A (ro 


1s to be introduced in the forward path. The maximum phase advance (,, 1s to be 
37” and is to occur at “m = 2 rad/s. Determine the expression for the phase angle 
(p and hence prove that fm and dm are as given below. Find from these expres- 
sions the values of a and T and calculate values for $ when w= 1, 1.5, 2,3 and 
Srad/s. Plot the compensator frequency response characteristics. 


So a—1 
ia a $ 
1 

ENT 


(c) Produce a table using the frequencies specified in part (a) for the compete open- 
loop frequency response including the compensation network and an amplifier to 
make up the insertion loss of 1/a. 


Plot these results on a Nichols chart and determine 


(1) Maximum closed-loop peak modulus, M, 
(11) Bandwidth (to —3dB point) 
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Solution 0.7 


MO 0 
Ñ 1 
= 0.356 + 0.7147 + 1.4295 + 1 


C 
qO 


Phase margin = 66” and Gain margin = 9dB 
1 (+5) 
b = + 5 
BS la + E) 
(c) Mp = 1dB and Bandwidth = 2.7 rad/s 


Example 6.13 
(a) A unity feedback control system has an open-loop transfer function 


1 


G(sSH(s) = SUENO HF 0.55) 


Construct, using asymptotes, the Bode diagram and read off values of open-loop 
modulus and phase for the following frequencies 


w (rad/s) = 0.1, 0.5, 1.0, 1.4, 2.0, 4.0, 6.0 and 10.0 


You may assume that at frequencies of 1.0 and 2.0 rad/s the open-loop phase angles 
are —162* and —198” respectively. 
Plot the results between 0.1 and 2.0 rad/s on a Nichols Chart and determine 


(1) the phase and gain margins 
(11) the maximum closed-loop modulus M, 
(111) the bandwidth to the —3dB point 


(b) The performance specification calls for a maximum closed-loop modulus of 
+1dB and a bandwidth of at least 1.8 rad/s. In order to achieve this, the follow- 
ing active lead compensation element is placed in the forward path 


-Ki(1475) 
PF 


Show that the phase advance f is given by 


EN ES =- E) 

1+7T7,T,? 
The frequency of maximum phase advance is to occur at the frequency that corre- 
sponds to —180” on the Bode diagram constructed in section (a). The lower break 
frequency 1/7 is to be half this value and the upper break frequency 1/T) is to be 
twice this value. Evaluate 7; and T» and calculate values of $ for the frequencies 
specified in section (a). Construct the Bode diagram for the compensation element 
for the condition K¡ = 1, and read off values of modulus at the same frequencies as 
the calculated phase values. 
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(c) Using the tables of modulus and phase for the plant and compensator found in 
sections (a) and (b), determine values for the new overall open-loop modulus and 
phase when the compensator is inserted in the forward path. 


Plot these results on a Nichols Chart and adjust the compensator gain K¡so that the 
system achieves the required performance specification. 
What are now the values of 


(1) the phase and gain margins 

(11) the maximum closed-loop modulus, M, 
(111) the bandwidth 
(1v) the compensator gain constant K; 


Solution 
(a) (1) Phase margin = 32” and Gain margin = 9.6dB 
(1) Mp =5dB 


(11) Bandwidth = 1.3 rad/s 
Ki(1 + 1.4295) 
(1 +0.3575) 
(c) (1) Phase margin = 47” and Gain margin = 13.5dB 
(11) M, = 1dB 
(111) Bandwidth = 1.85 rad/s 
(iv) K¡ = 0.861 


(b) G(s) = 
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7.1 Microprocessor control 


As a result of developments in microprocessor technology, the implementation of 
control algorithms is now invariably through the use of embedded microcontrollers 
rather than employing analogue devices. A typical system using microprocessor 
control is shown in Figure 7.1. 

In Figure 7.1 


e RAM is Random Access Memory and is used for general purpose working space 
during computation and data transfer. 

e ROM, PROM, EPROM is Read Only Memory, Programmable Read Only Mem- 
ory and Erasable Programmable Read Only Memory and are used for rapid 
sources of information that seldom, or never need to be modified. 

e A/D Converter converts analogue signals from sensors into digital form at a 
given sampling period 7 seconds and given resolution (8 bits, 16 bits, 24 bits, 
etc.) 

e D/A Converter converts digital signals into analogue signals suitable for driving 
actuators and other devices. 


The elements of a microprocessor controller (microcontroller) are shown in Figure 
7.2. Figure 7.2 shows a Central Processing Unit (CPU) which consists of 


e the Arithmetic Logic Unit (ALU) which performs arithmetic and logical oper- 
ations on the data 


and a number of registers, typically 


e Program Counter — incremented each time an instruction is executed 

e Accumulator(s) — can undertake arithmetic operations 

e Instruction register — holds current instruction 

e Data address register — holds memory address of data 

Control algorithms are implemented in either high level or low level language. The 
lowest level of code is executable machine code, which is a sequence of binary 
words that is understood by the CPU. A higher level of language is an assembler, 
which employs meaningful mnemonics and names for data addresses. Programs 
written in assembler are rapid in execution. At a higher level still are languages 
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Microprocessor ROM 
ysier RAM | PROM 
Memory | EPROM 
Memory 
r(kT) 
A/D c(kT) |  Microprocessor | U(KT)| D/A ¡ U(?) c(t) 
Converter HF) Controller H——=>> Converter > Plant 
Sensor ¡e 
Fig. 7.1 Microprocessor control of a plant. 
program counter 
RAM 
address bus 
accumulator(s) 
ALU 
: ' , ROM 
instruction register data bus PROM 
EPROM 
data address register 
CPU 


clock 


Fig. 7.2 Elements ofa microprocessor controller. 


such as C and C++, which are rapidly becoming industry standard for control 


software. 
The advantages of microprocessor control are 


e Versatility — programs may easily be changed 
e Sophistication — advanced control laws can be implemented. 
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The disadvantages of microprocessor control are 


e Works in discrete time — only snap-shots of the system output through the A/D 
converter are available. Hence, to ensure that all relevant data is available, the 
frequency of sampling is very important. 


7.2 Shannon's sampling theorem 


Shannon's sampling theorem states that “A function f(t) that has a bandwidth wp 1s 
uniquely determined by a discrete set of sample values provided that the sampling 
frequency is greater than 2wp”. The sampling frequency 2wy is called the Nyquist 
frequency. 

It is rare in practise to work near to the limit given by Shannon's theorem. A useful 
rule of thumb is to sample the signal at about ten times higher than the highest 
frequency thought to be present. 

If a signal is sampled below Shannon's limit, then a lower frequency signal, called 
an alias may be constructed as shown in Figure 7.3. 

To ensure that aliasing does not take place, it is common practice to place an anti- 
aliasing filter before the A/D converter. This is an analogue low-pass filter with a 
break-frequency of 0.5w, where ws is the sampling frequency (ws > 10). The higher 
ws is In comparison to wy, the more closely the digital system resembles an analogue 
one and as a result, the more applicable are the design methods described in Chapters 
5 and 6. 


Original Signal Alias 


Fig. 7.3 Construction of an alias due to undersampling. 
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7.3 Ideal sampling 


An ideal sample f*(t) of a continuous signal f(£) is a series of zero width impulses 
spaced at sampling time T seconds apart as shown in Figure 7.4. 
The sampled signal is represented by equation (7.1). 


FO0= Y fUT)Ó(1 —kT) (.1) 


k==00 


where ó(t — kT) is the unit impulse function occurring at 1 =XT. 

A sampler (1.e. an A/D converter) is represented by a switch symbol as shown in 
Figure 7.5. It is possible to reconstruct f(t) approximately from f*(t) by the use of a 
hold device, the most common of which is the zero-order hold (D/A converter) as 
shown in Figure 7.6. From Figure 7.6 1t can be seen that a zero-order hold converts a 
series of impulses into a series of pulses of width 7. Hence a unit impulse at time fs 
converted into a pulse of width T, which may be created by a positive unit step at 
time £, followed by a negative unit step at time (1 — T), 1.e. delayed by T. 

The transfer function for a zero-order hold is 


LIf0]==-=eP 
(7.2) 
l-eP 
Gn(s) = 
f(t) P(0) 
T f(6T) f(kT) 
> 
t10 T 2T 3T 4T 5T 6T ..... kT  t 
(a) Continuous Signal (b) Sampled Signal 


Fig. 7.4 The sampling process. 


Fig. 7.5 A sampler. 
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f:(1) 1() 
T 
> > 
t t 
(a) Discrete Time Signal (b) Continous Time Signal 


Fig. 7.6 Construction of a continuous signal using a zero-order hold. 


7.4 The z-transform 


The z-transform is the principal analytical tool for single-input-single-output dis- 
crete-time systems, and is analogous to the Laplace transform for continuous systems. 
Conceptually, the symbol z can be associated with discrete time shifting in a 
difference equation in the same way that s can be associated with differentiation in 
a differential equation. 
Taking Laplace transforms of equation (7.1), which is the ideal sampled signal, 


glves 
Fu=2F(01=) De * (7.3) 
k=0 
or 
Fs) = YN NAT!) * (7.4) 
k=0 
Define z as 
z¿=eT (7.5) 
then 
Fl) =Y [4D *=Z1/01 (7.6) 
k=0 


In Tlong-hand” form equation (7.6) is written as 


FO=f0+£D7 +f£QD2?*+---+£(kT)3* (7.7) 


Example 7.1 
Find the z-transform of the unit step function f(t) = 1. 
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0 de 2T 37 4T t 


Fig. 7.7 z-Transform of a sampled unit step function. 


Solution 
From equations (7.6) and (7.7) 


Z[1(0] = 3 LT) (7.8) 
k=0 
or 
Fn=lerltar*e. yt (7.9) 


Figure 7.7 shows a graphical representation of equation (7.9). 
Equation (7.9) can be written in “closed form” as 


1 
Z[1(0)] ===. (7.10) 


Equations (7.9) and (7.10) can be shown to be the same by long division 


+ i++... 
2-1)z 0 0 


z-—1 

0+1 
o 
0+z7 


pl” 7.11) 


Table 7.1 gives Laplace and z-transforms of common functions. 
z-transform Theorems: 


(a) Linearity 


ZIA(O +40] = Fi(z) + Fa(2) (7.12) 
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Table 7.1 Common Laplace and z-transforms 


FO or FT) F(s) F(2) 
1 50) 1 1 
2 ó(1 —kT) e q 
1 z 
3 1 E 
(0) Ss z=1 
1 Tz 
4 t 3 
y z-1y 
1 z 
5 —at e AN 
E (s+a) z—eaT 
6 1 gu a ql ss E — e 
s(s +) z- 1 -eT) 
a Mar14070) SE A 
a sUs+ a) a(z— Dz -e-T) 
E nda 5) zsinwT 
ala +? 22—2zco0swT +1 
Ss z(z —coswT) 
9 t PA ros Td 
cos +? 22 —2zcoswT +1 
w ze sinwT 
10 AAN 1 A 
E SILA (+07 + 2 22 —2ze“T coswT + e-2aT 
», s+a) 2=zTecoswT 
1 1 at t +a) 
FAROS +0 +02 22 —2zeT coswT + e2aT 


(b) Initial Value Theorem 
F(0) = lim F(2) 


f(o) =lim (E -) eto) 


7.4.1 Inverse transformation 


(c) Final Value Theorem 


The discrete time response can be found using a number of methods. 
(a) Infinite power series method 


Example 7.2 
A sampled-data system has a transfer function 


1 
ica 


(7.13) 


(7.14) 
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If the sampling time is one second and the system is subject to a unit step input 
function, determine the discrete time response. (N.B. normally, a zero-order hold 
would be included, but, in the interest of simplicity, has been omitted.) Now 


Xolz) = G(z)Xi(2) (7.15) 
from Table 7.1 
Z YA 
xa) = (7) 5) (1.16) 
for T = 1 second 
vA Z 
2 E A 0) e E ,) 
2 
E 0.17) 


— 2 — 1.3687 + 0.368 
By long division 


14 1.3687! + 1.5037? +--- 
2? - 1.3682 40.368)? 0 o 0 


2? — 1.3682 + 0.368 
0 + 1.368z — 0.368 
1.368z — 1.871 + 0.5037! 


0 + 1.503 — 0.50327' 
1.503 — 2.0562! + 0.5532? (7.18) 


Thus 
xo(0) = 1 
Xo(1) = 1.368 
Xo(2) = 1.503 


(b) Difference equation method 
Consider a system of the form 


Xo bo+biz!l+ba2?*+--- 
= 7.19 
X; E) l+az!+az?+-.. Ena 
Thus 
(1+azl+az?t+-- IX 2) =(bo+ biz! +b327?+---)Xi(2) (7.20) 
or 


Xol2) =(=ajz? =a223 ++) Xo(2) + (bo + hi2" +32 + + X 2) (7.21) 


Equation (7.21) can be expressed as a difference equation of the form 
xo(kT) = —axo(k — 1)T — a9xo[k — 2)T 
+ boxi(kT) + bixi(k — 1)T + b2xi(k-2)T +::- (7.22) 
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In Example 7.2 


o 1 
A =1+s 
=z 7 q 036 a 
Equation (7.23) can be written as 
xo Te nan ei 
Equation (7.24) is in the same form as equation (7.19). Hence 
(1 — 0.3687) Xo(z) = Xi(z) 
or 
Xo(z) = 0.3687 *Xo(z) + Xi(z) (7.25) 
Equation (7.25) can be expressed as a difference equation 
xo(kT) =0.368x.(k — 1)T + x (KT) (7.26) 


Assume that x.(—1) =0 and x¡(kT) = 1, then from equation (7.26) 
xo(0)=0+1=1, k=0 
xo(1) = (0.368 x 1) + 1=1.368, k=1 
Xxo(2) = (0.368 x 1.368) + 1=1.503, k=2- etc. 


These results are the same as with the power series method, but difference equations 
are more suited to digital computation. 


7.4.2 The pulse transfer function 


Consider the block diagrams shown in Figure 7.8. In Figure 7.8(a) U*(s) is a sampled 
input to G(s) which gives a continuous output Xo(s), which when sampled by a 


Us) U*(s) als Xo(s) X3(s) 
T F 
(a) 
U(z) Xo(2) 
IS E 


Fig. 7.8 Relationship between G(s) and G(2). 
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U(s) U*(s) X(s) X*(s) Xo(S) Xx 
E — G, (s) > > G,(s) E A 
T 
(a) 


mk XxX * 
U(s) U*(s) G.(s) X(s) > Gs) (Ss) A X3(s) 


Fig. 7.9 Blocks in cascade. 


synchronized sampler becomes X¿(s). Figure 7.8(b) shows the pulse transfer function 
where U(z) is equivalent to U*(s) and Xo(z) is equivalent to X¿(s). 
From Figure 7.8(b) the pulse transfer function is 


20 =G(z) (7.27) 


Blocks in Cascade: In Figure 7.9(a) there are synchronized samplers either side of 
blocks G¡(s) and G»(s). The pulse transfer function is therefore 


Ze) = Gue)GxS (7.28) 


In Figure 7.9(b) there is no sampler between G¡(s) and Ga2(s) so they can be combined 
to give G¡(s)G2(s), or G¡Gr(s). Hence the output Xo¿(z) is given by 
Xo(=) = Z[G¡Ga(s)) U(2) (7.29) 


and the pulse transfer function is 

Xo 

y = 6161) (7.30) 
Note that G¡(2)3G(2) A G¡G»(2). 


Example 7.3 (See also Appendix 1, examp73.m) 

A first-order sampled-data system is shown in Figure 7.10. 

Find the pulse transfer function and hence calculate the response to a unit step and 
unit ramp. 7 =0.5 seconds. Compare the results with the continuous system 
response xo(1). The system is of the type shown in Figure 7.9(b) and therefore 


G(s) = G1GxÍs) 


Inserting values 


_ —Ts 1 
Ge (1-é Ms 5) (7.31) 
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1=8e " 
A 


7 


X(S) 


L, 
n 
| pe 


| 


Fig. 7.10 First-order sampled-data system. 


Taking z-transforms using Table 7.1. 


E a (1 —e?) 
G(z)=(l-z NE ==” (7.32) 
or 
(2-1 dl —e”) 
E E 013) 
which gives 
1-e? 
G(z) = ( = +) (7.34) 
For T = 0.5 seconds 
0.393 
RS ( a 0.001) 1:35) 
hence 
Xo 0.3937! 
> ( a a) 000) 
which is converted into a difference equation 
xo(kT) =0.607x.(k — 1)T + 0.393x;(k — 1)T (7.37) 


Table 7.2 shows the discrete response x.(kT) to a unit step function and is compared 
with the continuous response (equation 3.29) where 


xo(1) =(1 e") (7.38) 


From Table 7.2, it can be seen that the discrete and continuous step response 1s 
identical. Table 7.3 shows the discrete response x(kT') and continuous response x(t) 
to a unit ramp function where x/(£) is calculated from equation (3.39) 


x(0)=t-=1+e* (7.39) 


In Table 7.3 the difference between x.(kT') and x/(t) is due to the sample and hold. 
It should also be noted that with the discrete response x(kT), there is only knowledge 
of the output at the sampling instant. 
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Table 7.2 Comparison between discrete and continuous step response 


k kT (seconds) xi(kT) xo(kT) Xo(1) 
-1 0.5 0 0 0 
0 0 1 0 0 
1 0.5 1 0.393 0.393 
2 1.0 1 0.632 0.632 
3 LS 1 0.776 0.776 
4 2.0 1 0.864 0.864 
$ 29 1 0.918 0.918 
6 3.0 1 0.950 0.950 
7 3.5 1 0.970 0.970 
8 4.0 1 0.982 0.982 


Table 7.3 Comparison between discrete and continuous ramp response 


k kT (seconds) xi(kT) xo(kT) Xo(1) 
-1 0.5 0 0 0 
0 0 0 0 0 
1 0.5 0.5 0 0.107 
2 1.0 1.0 0.304 0.368 
3 1.5 1:5 0.577 0.723 
4 2.0 2.0 0.940 1.135 
5 2.5 2.5 1.357 1.582 
6 3.0 3.0 1.805 2.050 
7 3.5 3.5 2.275 2.530 
8 4.0 4.0 2.757 3.018 


7.4.3 The closed-loop pulse transfer function 


Consider the error sampled system shown in Figure 7.11. Since there is no sampler 
between G(s) and H(s) in the closed-loop system shown in Figure 7.11, it 1s a similar 
arrangement to that shown in Figure 7.9(b). From equation (4.4), the closed-loop 


pulse transfer function can be written as 


Co. G() 
ROS iFG6HO An) 
In equation (7.40) 
GH(2) = Z1GH(s)) (7.41) 
R(s) Cís) 


0] 


El E* 
(s) EN (s) 
T 


Fig. 7.11 Closed-loop error sampled system. 
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Fig. 7.12 Closed-loop error and output sampled system. 


Consider the error and output sampled system shown in Figure 7.12. In Figure 7.12, 
there is now a sampler between G(s) and H(s), which is similar to Figure 7.9(a). From 
equation (4.4), the closed-loop pulse transfer function is now written as 


Co - 0 
RO TTFEGOHO) 


(7.42) 


7.5 Digital control systems 


From Figure 7.1, a digital control system may be represented by the block diagram 
shown in Figure 7.13. 


Example 7.4 (See also Appendix 1, examp74.m) 
Figure 7.14 shows a digital control system. When the controller gain K is unity and 
the sampling time is 0.5 seconds, determine 


(a) the open-loop pulse transfer function 

(b) the closed-loop pulse transfer function 

(c) the difference equation for the discrete time response 

(d) a sketch of the unit step response assuming zero initial conditions 
(e) the steady-state value of the system output 


* sa id Zero 
eto (| Digitar | U“(1) 
> Controller H—>| Order [43] Plant 


e cn E e E j 


Sensor  |4 


Fig. 7.13 Digital control system. 
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Rís Hs C(s) 
Ss E ion 


T=0.5 


Fig. 7.14 Digital control system for Example 7.4. 


Solution 
le? l 
G(s) = K 7.43 
o E sd 
Given K=1 
1 
=(1-e” 44 
asf E + 5) 109] 
Partial fraction expansion 
l A B C 
= 7.45 
ss +2) (+ 5) A) 
or 
l =s(s + 2)4 + (s + 2)B + 5s?C (7.46) 
Equating coefficients gives 
A = -0.25 
B=0.5 
C=0.25 


Substituting these values into equation (7.44) and (7.45) 


ri f-0.25 05 0.25 
G(s)= (l—e Al SA a) (7.47) 
or 
Ml 0 1 2 1 
G(s) = 0.25(1 —e Ñ Hat) (7.48) 
Taking z-transforms 
1 ==, 2Tz Z 
G(z) =0.25(1-—z e p” EN >) (7.49) 


Given T = 0.5 seconds 


2-1 f -1 ,2x05 1 
Gt) =025/ - Hor a-y 00) (7.50) 
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Hence 
—1(2 — 1) — 0.368) + (z — 0.368) + (z — La 
G(z) = 0.25(z DM ESPE (7.51) 
—22 + 1.3687 — 0.368 + z — 0.368 + 22 — 22 +1 
G(2) = 025( E =D 0368) ) (7.52) 


which simplifies to give the open-loop pulse transfer function 


0.0927 + 0.066 
AER ( — 1.3682 + a 500) 


Note: This result could also have been obtained at equation (7.44) by using z-trans- 
form number 7 in Table 7.1, but the solution demonstrates the use of partial frac- 
tions. 


(b) The closed-loop pulse transfer function, from equation (7.40) is 


( 0.0927+0.066 ) 


C 22-1.3682+0.368 
RU = ( + na) (7.54) 
22—1.3682+0.368 
which simplifies to give the closed-loop pulse transfer function 
C 0.092z + 0.066 
ROS 2 1.2762 + 0.434 (7.55) 
or 
€ 0.0927”! + 0.0667”? 
RO 11276714 0.43477 (7.56) 


(c) Equation (7.56) can be expressed as a difference equation 
AkT) = 1.276c(k — 1)T' — 0.434c(k — 2)T + 0.092r(k — 1)T + 0.066r(k — 2)T 
(7.57) 


(d) Using the difference equation (7.57), and assuming zero initial conditions, the 
unit step response is shown in Figure 7.15. 


Note that the response in Figure 7.15 is constructed solely from the knowledge of the 
two previous sampled outputs and the two previous sampled inputs. 


(e) Using the final value theorem given in equation (7.14) 


1 
z 


: z=1 0.092z + 0.066 Z 
00) = lim (| z MK = e ES 3 que) 


e(00) = lim (E = ) ZORO] (7.58) 
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0 0.5 1 1.5 2 25 3 3.5 4 4.5kT 


Fig. 7.15 Unit step response for Example 7.4. 


0.092 + 0.066 
a (; =1276+ 5) 100 SU) 


Hence there is no steady-state error. 


7.6 Stability in the z-plane 
7.6.1 Mapping from the s-plane into the z-plane 


Just as transient analysis of continuous systems may be undertaken in the s-plane, 
stability and transient analysis on discrete systems may be conducted in the z-plane. 
It is possible to map from the s to the z-plane using the relationship 


z¿=e" (7.61) 
now 
s=0tju 
therefore 
z=e 007 — gTejT (using the positive jw value) (7.62) 
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PZ) 


|zl=0” 


Z<Z=wT=21m4/ws 


Re 
Fig. 7.16 Mapping from the s to the z-plane. 
If e”? = |z| and T = 27/w, equation (7.62) can be written 
z = [zJeiBro/us) (7.63) 


where ws 1s the sampling frequency. 

Equation (7.63) results in a polar diagram in the z-plane as shown in Figure 7.16. 
Figure 7.17 shows mapping of lines of constant o (1.e. constant settling time) from the 
sto the z-plane. From Figure 7.17 1t can be seen that the left-hand side (stable) of the 
s-plane corresponds to a region within a circle of unity radius (the unit circle) in the z- 
plane. 

Figure 7.18 shows mapping of lines of constant w (i.e. constant transient fre- 
quency) from the s to the z-plane. 


ju Los 
A D 
(a) (b)  (c) 
A A A 
w=k 
2 
-0 0=0 +o 0 ey 08 
2 
A A A 
—4s w=% | stable region 
O OO > 4 
s-plane z-plane 


Fig. 7.17 Mapping constant o from sto z-plane. 
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ju 
Sus 
E d 
- » 
paz 
8 
O 
s-plane z-plane 


Fig. 7.18 Mapping constant w from sto z-plane. 
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Fig. 7.19 Corresponding pole locations on both sand z-planes. 


Figure 7.19 shows corresponding pole locations on both the s-plane and z-plane. 


7.6.2 The Jury stability test 


In the same way that the Routh-Hurwitz criterion offers a simple method of 
determining the stability of continuous systems, the Jury (1958) stability test 1s 
employed in a similar manner to assess the stability of discrete systems. 

Consider the characteristic equation of a sampled-data system 


0O()=a/" +4 17 +4 -+ajz+a9=0 (7.64) 
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Table 7.4 Jury's array 


VA z YA YA zZ 
4) a (49) An—1 An 
Un An—1 An-2 a a 
bo by b, Bp-1 

dn-1 bn-2 Dn-3 do 

bh l h bh 

bh h l b 

mo mi m 

m mi mo 


The array for the Jury stability test is 


b k 


Ck 


de == 


given in Table 7.4 where 


4%  An—k 
Un Ax 
do Dn-1-k ' 65) 
Dn-1 De 
CO Cn-2—k 
Cn-2 Ck 


The necessary and sufficient conditions for the polynomial O(z) to have no roots 


outside or on the unit circle are 


Condition 1 
Condition 2 
Condition 3 


Condition n 


00)>0 
IO) >0 
dol < a, 

bol > |b-1| 


(7.66) 
co] > [Cn-2| 


mol > |m>]| 


Example 7.5 (See also Appendix 1, examp75.m) 
For the system given in Figure 7.14 (1.e. Example 7.4) find the value of the digital 
compensator gain K to make the system just unstable. For Example 7.4, the char- 


acteristic equation is 


1+G()=0 


(7.67) 


In Example 7.4, the solution was found assuming that K = 1. Therefore, using 
equation (7.53), the characteristic equation is 


1+ 


K(0.092z + 0.066) 


(7.68) 


(22 — 1.3687 + 0.368) 
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or 
O(=) = 2? +(0.092K — 1.368)z + (0.368 + 0.066K) = 0 (7.69) 
The first row of Jury's array is 
| Fa 7 ? 


7.70 
(0.368 + 0.066K) (0.092K — 1.368) 1 40) 


Condition 1: O(1) > 0 
From equation (7.69) 


O(1) = [1 + (0.092K — 1.368) + (0.368 + 0.066K)) > 0 OTD 
From equation (7.71), O(1) > 01f K >0. 


Condition 2 (-10(-1) > 0 
From equation (7.69), when n = 2 


ED?O0(=1) = (1 -— (0.092K — 1.368) + (0.368 + 0.066K)) > 0 (7.72) 
Equation (7.72) simplifies to give 
2.736 — 0.026K > 0 


or 


- 2.736 
0.026 


K = 105.23 (7.73) 


Fig. 7.20 Root locus diagram for Example 7.4. 
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Condition 3: [ay| < az 
10.368 + 0.066K| < 1 (7.74) 
For marginal stability 


0.368 + 0.066K = 1 


- (1.75) 
K-= 1 — 0.368 —958 
0.066 
Hence the system is marginally stable when K = 9.58 and 105.23 (see also Example 
7.6 and Figure 7.20). 


7.6.3 Root locus analysis in the z-plane 


As with the continuous systems described in Chapter 5, the root locus of a discrete 
system is a plot of the locus of the roots of the characteristic equation 


1+GH(2)=0 (7.76) 


in the z-plane as a function of the open-loop gain constant K. The closed-loop system 
will remain stable providing the loci remain within the unit circle. 


7.6.4 Root locus construction rules 


These are similar to those given in section 5.3.4 for continuous systems. 


1. Starting points (K = 0): The root loci start at the open-loop poles. 

2. Termination points (K = co): The root loci terminate at the open-loop zeros when 
they exist, otherwise at oo. 

3. Number of distinct root loci: This is equal to the order of the characteristic 
equation. 

4. Symmetry of root loci: The root loci are symmetrical about the real axis. 

5. Root locus locations on real axis: A point on the real axis is part of the loci if the 
sum of the open-loop poles and zeros to the right of the point concerned is odd. 

6. Breakaway points: The points at which a locus breaks away from the real axis can 
be found by obtaining the roots of the equation 


d 
q eHo) =0 


7. Unit circle crossover: This can be obtained by determining the value of K for 
marginal stability using the Jury test, and substituting it in the characteristic 
equation (7.76). 


Example 7.6 (See also Appendix 1, examp76.m) 
Sketch the root locus diagram for Example 7.4, shown in Figure 7.14. Determine the 
breakaway points, the value of K for marginal stability and the unit circle crossover. 
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Solution 
From equation (7.43) 


e Ts 1 
0=k(1 - Ha) (0.77) 


and from equation (7.53), given that T' = 0.5 seconds 


AE (a a 055) dió 
Open-loop poles 
z? — 1.3687 + 0.368 =0 (7.79) 
z= 0.684 + 0.316 
= l and 0.368 (7.80) 
Open-loop zeros 
0.092z + 0.066 = 0 
z= 0.717 (7.81) 
From equations (7.67), (7.68) and (7.69) the characteristic equation is 
7? + (0.092K — 1.368)z + (0.368 + 0.066K) =0 (7.82) 


Breakaway points: Using Rule 6 


d 
(2? — 1.368z + 0.368) K(0.092) — K(0.092z + 0.066/(2z — 1.368) =0 (7.83) 
which gives 


0.0922? + 0.132z — 0.1239=0 
z =0.647 and —2.084 (7.84) 


K for marginal stability: Using the Jury test, the values of K as the locus crosses the 
unit circle are given in equations (7.75) and (7.73) 


K = 9.58 and 105.23 (7.85) 
Unit circle crossover: Inserting K = 9.58 into the characteristic equation (7.82) gives 
722 —-0.4872+1=0 (7.86) 

The roots of equation (7.86) are 
z = 0.244 530.97 (7.87) 


or 


z=1/+75.9 =1/+1.33 rad (7.88) 
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Since from equation (7.63) and Figure 7.16 
z=|2|“wT (7.89) 
and T' = 0.5, then the frequency of oscillation at the onset of instability is 


0.5w = 1.33 


7.90 
w= 2.66 rad/s Oe 


The root locus diagram is shown in Figure 7.20. 
It can be seen from Figure 7.20 that the complex loci form a circle. This is usually 
the case for second-order plant, where 


Radius = y lopen-loop poles| 
Centre = (Open-loop zero, 0) (7.91) 


The step response shown in Figure 7.15 is for K=1. Inserting K= 1 into the 
characteristic equation gives 


7? — 1.2767 + 0.434 =0 
or 


z = 0.638 + 30.164 


This position is shown in Figure 7.20. The K values at the breakaway points are also 
shown in Figure 7.20. 


7.7 Digital compensator design 


In sections 5.4 and 6.6, compensator design in the s-plane and the frequency domain 
were discussed for continuous systems. In the same manner, digital compensators 
may be designed in the z-plane for discrete systems. 

Figure 7.13 shows the general form of a digital control system. The pulse transfer 
function of the digital controller/compensator is written 


U 
5) =DG) (7.92) 


and the closed-loop pulse transfer function become 


Co. D(z)G(2z) 
ROS TIEDOGHO 


(7.93) 


and hence the characteristic equation is 


1+ D(23GH(2)=0 (7.94) 
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7.7.1 Digital compensator types 


In a continuous system, a differentiation of the error signal e can be represented as 


u(t) = da 


e 
dí 
Taking Laplace transforms with zero initial conditions 


(9) =S (7.95) 


In a discrete system, a differentiation can be approximated to 


AkT)— e(k-— 1)T 


kT) = 
u(kT) A 
hence 

U 1-2! 

e = 7.9 

FO==Ñ (7.96) 
Hence, the Laplace operator can be approximated to 

l=zz? 2-1 
$ =p == (7.97) 


Digital PID controller: From equation (4.92), a continuous PID controller can be 
written as 


U,. KiT;¡Tas+T¡s+1) 


a 7.98 
E) Ts (7.98) 
Inserting equation (7.97) into (7.98) gives 
ou KnT +1) +1) 
(2) = E (7.99) 
E Té) 
which can be simplified to give 
U _ Ki(ba2? + biz + bg) 
gU)= AED) (7.100) 
where 
T 
bo==7 
2T4 
bi = (1 = 7) (7.101) 
A EE 
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Tustin's Rule: Tustin's rule, also called the bilinear transformation, gives a better 
approximation to integration since 1t is based on a trapizoidal rather than a rect- 
angular area. Tustin's rule approximates the Laplace transform to 


_Az—1) 


Inserting this value of s into the denominator of equation (7.98), still yields a digital 
PID controller of the form shown in equation (7.100) where 


T, 
Do => 
T  2T4 
bi = (-E- 1) (7.103) 
_(T Ta 
b, = (+ E+ 1) 


Example 7.7 (See also Appendix 1, examp77.m) 
The laser guided missile shown in Figure 5.26 has an open-loop transfer function 
(combining the fin dynamics and missile dynamics) of 


20 


G(s)H(s) = ss E5) 


(7.104) 


A lead compensator, see case study Example 6.6, and equation (6.113) has a transfer 
function of 


0.8(1 +5) 


AS = 1006259) 


(7.105) 


(a) Find the z-transform of the missile by selecting a sampling frequency of at least 
10 times higher than the system bandwidth. 

(b) Convert the lead compensator in equation (7.105) into a digital compensator 
using the simple method, i.e. equation (7.97) and find the step response of the 
system. 

(c) Convert the lead compensator in equation (7.105) into a digital compen- 
sator using Tustin's rule, 1.e. equation (7.102) and find the step response of the 
system. 

(d) Compare the responses found in (b) and (c) with the continuous step response, 
and convert the compensator that is closest to this into a difference equation. 


Solution 
(a) From Figure 6.39, lead compensator two, the bandwidth is 5.09 rad/s, or 
0.81 Hz. Ten times this is 8.1 Hz, so select a sampling frequency of 10 Hz, 1.e. 
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T =0.1 seconds. For a sample and hold device cascaded with the missile 


dynamics 
l-e* 20 
205 ( S ) E + 5) o 
e en 20 
G(s=(-—e E En 5) (7.107) 


For T = 0.1, equation (7.107) has a z-transform of 


0.002962? + 0.01048z + 0.0023 
23 — 2.60652? + 2.2131z — 0.6065 


G(=) = (7.108) 


(b) Substituting 


| 
o Tz 


into lead compensator given in equation (7.105) to obtain digital compensator 


Tz+(2-1) 
ee Tz 
202081 m0 


Tz 


This simplifies to give 
5.4152z — 4.923 


DI) == 0.3846 100) 
(c) Using Tustin's rule 
az) 
Em 
Substituting into lead compensator 
T+1) 4221) 
e T4D) 
D(=) =0.8 T(2+1)+0.0625(2(2-1)) 
TG+D 
This simplifies to give 
7.467z — 6.756 
DIS (7.110) 


(d) From Figure 7.21, 1t can be seen that the digital compensator formed using 
Tustin”s rule is closest to the continuous response. From equation (7.110) 


7.467 — 6.7567”! 
1 —0.11127! 


F0= (7.111) 
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2 = 
c(kT) Continuous 
1.84 
Simple method 
1.64 


Tustin's rule 


0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 
kT (seconds) 


Fig. 7.21 Comparison between discrete and continuous response. 


Hence the difference equation for the digital compensator is 


u(kT) =0.111u(k — 1)T +7.467e(kT) — 6.756e(k — 1)T (7.112) 


7.7.2 Digital compensator design using pole placement 
Case study 


Example 7.5 (See also Appendix 1, examp78.m) 
The continuous control system shown in Figure 7.22(a) is to be replaced by the digital 
control system shown in Figure 7.22(b). 


(a) For the continuous system, find the value of K that gives the system a damping 
ratio of 0.5. Determine the closed-loop poles in the s-plane and hence the values 
of o and w. 

(b) Find the closed-loop bandwidth ww and make the sampling frequency w, a factor 
of 10 higher. What is the value of 7? 

(c) For the sampled system shown in Figure 7.22(b), find the open-loop pulse trans- 
fer function G(z) when the sample and hold device is in cascade with the plant. 

(d) With D(2) set to the value of K found in (a), compare the continuous and discrete 
step responses. 
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C(s) 


s(s+1) 


RS + 


— Pl) mn 12 > s(s+1) 


(b) 
Fig. 7.22 Continuous and digital control systems. 


(e) By mapping the closed-loop poles from the s to the z-plane, design a compensator 
D(z) such that both continuous and sampled system have identical closed-loop 
response, 1.e. ( =0.5. 


Solution 
(a) The root-locus diagram for the continuous system in shown in Figure 7.23. From 
Figure 7.23 the closed-loop poles are 


s = —0.5 +30.866 (7.113) 
or 
o=-—0.5, “w=0.866 rad/s 
and the value of K is 0.336. 


(b) Plotting the closed-loop frequency response for the continuous system gives a 
bandwidth wy of 1.29 rad/s(0.205 Hz). The sampling frequency should therefore 
be a factor of 10 higher, 1.e. 12.9 rad/s(2.05 Hz). Rounding down to 2.0 Hz gives 
a sampling time 7 of 0.5 seconds. 


i= zo 3 
(0) G)=(1-z A) (7.114) 


Using transform 7 in Table 7.1 


Ml 31(e795 — 0.5)z + (1 — 1.5e7%5)) 
o (z — 1) — e-05) 


G(2) 
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(=0.5 jo 


K=0.336 0.866 


v 
Fig. 7.23 Root locus diagram for continuous system. 


Hence 


0.3196(= + 0.8467) 


aa E = DE — 0.6065) 


(7.115) 


(d) With D(=) = K = 0.336, the difference between the continuous and discrete step 
response can be seen in Figure 7.24. 
(e) Mapping closed-loop poles from s to z-plane 


l2| =e"7 
inserting values 
[z] = 003x035 = 0,779 (7.116) 
lz=wT 
= 0.866 x 0.5 = 0.433 rad (7.117) 
= 24.8" 


Converting from polar to cartesian co-ordinates gives the closed-loop poles in the z- 
plane 


z=0.707 + j0.327 (7.118) 


which provides a z-plane characteristic equation 


z? — 1.4142 +0.607 =0 (7.119) 
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1.47 Discrete 


Continuous 


0 do T T T T T T T Ñ 1 
0 1 2 3 4 5 6 7 8 9 10 
t, kT (seconds) 


Fig. 7.24 Continuous and digital controllers set to K = 0.336. 


The control problem is to design a compensator D(z), which, when cascaded with 
G(z), provides a characteristic equation 


1 + D(2)G(2) =0 (7.120) 


such that the equations (7.119) and (7.120) are identical. Let the compensator be of 
the form 


K(z- a) 
D(2) = .121 
=>» (7.121) 
Select the value of a so that the non-unity pole in G(z) is cancelled 
DG) = K(z— 0.6065) 0.3196(z + 0.8467) (7.122) 


G+b (¿DG -0.6065) 
Hence the characteristic equation (7.120) becomes 


0.3196K(z + 0.8467) — 
EXDE=D 7 


which simplifies to give 


22 +(0.3196K + b-— 1)z + (0.2706K — b)=0 (7.123) 
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Continuous 
c(t) and Discrete 


0 1 2 3 4 5 6 7 8 9 10 
t, kT (seconds) 


Fig. 7.25 Identical continuous and discrete step responses as a result of pole placement. 


Equating coefficients in equations (7.119) and (7.123) gives 


0.3196K +b-—1=-—1.414 (7.124) 
0.2706K — b = 0.607 (7.125) 
Add 0.5902K-— 1 = 0.807 


or 
0.5902K = 0.193 
K =0.327 (7.126) 
Inserting equation (7.126) into (7.125) 
(0.2706 x 0.327) — 0.607 =b 


7.127 
b= -—0.519 ( ) 
Thus the required compensator is 
_U,.  0.327(z— 0.6065) 
D)=F¿0= E 0519) (7.128) 


Figure 7.25 shows that the continuous and discrete responses are identical, both with 
(= 0.5. The control algorithm can be implemented as a difference equation 
(1 —0.606527!) 


U 
E a 


(7.129) 


hence 


u(kT) =0.327e(kT) — 0.1983e(k — 1)T +0.519u(k — 1)T (7.130) 
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7.8 Further problems 


Example 7.9 
Assuming that a sample and hold device is in cascade with the transfer function G(s), 
determine G(z) for the following 


(a) G(s) = qm T =0.1 seconds 
(s +1) 
(b) G(s) = a T = 0.5 seconds 
—(s+ D(s +2)” e 
1 

(c) Gls) = +05” T = 1.0 seconds 
Solution 

0.095 
(2) 0)== 0905 

0.155(z + 0.606) 
b = 
(1) 6= 270974740223 

0.426(z + 0.847 
() am= A 


22 — 1.607z + 0.607 


Example 7.10 
The computer control system shown in Figure 7.26 has a sampling time of 0.5 
seconds 


(a) Find the open-loop pulse transfer function G(z) and hence determine the open- 
loop poles and zeros for the combined sample and hold and the plant. 

(b) From (a) evaluate the difference equation relating c(kT), c(k— 1)T, c(k-— 2T, 
u(k — 1)T and u(k — 2)T. 

(c) If the computer has the control algorithm 


u(kT)= 1.Se(kT) 


Computer Plant 
RS) + Ts 2 C(s) 
l=e 
pa —> K » E > s(s+4) 
r 


Fig. 7.26 Computer control system for Example 7.10. 
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using a tabular approach, calcuate the system response when the input is a unit 
step applied at kT = 0 for the discrete time values of kT' = 0, 0.5, 1.0, 1.5, 2.0 and 
2.5 seconds. Assume that at kT less than zero, all values of input and output 
are zero. 


Solution 


0.1419(z + 0.523) 
22 — 1.1352 + 0.135 


poles z=1,0.135 


zeros z= -—0.523 


(a) G(2) = 


(b) AkT) = 1.135c(k — 1)7 — 0.135c(k — 2)T + 0.1419u(k — 1)T +0.0743u(k — 2)T 


(c) KT 0 0.5 1.0 1.5 2.0 2.5 
AkT) 0 0.213 0.521 0.752 0.889 0.959 


Example 7.11 
A unity feedback computer control system, has an open-loop pulse transfer function 


0.426K(z + 0.847) 


(5) = 216072 + 0.607 


(a) Determine the open-loop poles and zeros, the characteristic equation and break- 
away points. 

(b) Using the Jury test, determine the value of K at the unit-circle crossover points. 

(c) Find the radius and centre of the circular complex loci, and hence sketch the root 
locus in the z-plane. 


Solution 
(a) poles z= 1, 0.607 
zeros z= -—0.847 
2? + (0.426K — 1.607)z + (0.361K + 0.607) = 0 
breakaway points z=0.795, -2.5 


(b) K = 1.06, 47.9 
(c) radius = 1.607, centre = —0.847, 0 


Example 7.12 
A unity feedback continuous control system has a forward-path transfer function 


K 
IS s(s +5) 


(a) Find the value of K to give the closed-loop system a damping ratio of 0.7. The 
above system is to be replaced by a discrete-time unity feedback control system 
with a forward-path transfer function 
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poa 1 
=D ol a Ms) 


(b) If the sampling time is 0.2 seconds, determine the open-loop pulse transfer 
function. 

(c) The discrete-time system is to have the identical time response to the continuous 
system. What are the desired closed-loop poles and characteristic equations in 


(1) the s-plane 
(11) the z-plane 


(d) The discrete-time compensator is to take the form 


K; (z + a) 
D(2) = 
NET 
Find the values of K¡ and b if a is selected to cancel the non-unity open-loop pole. 
Solution 
(a) K= 12.8 
0.0147(z + 0.718 
(b) Go) = A 


(z — 1) — 0.368) 
(c) -2.48+j2.56, s.+55+ 12.8=0 
0.531 +j0.298, 2? —1.062z + 0.371 =0 


(2 — 0.368) 
(¿ — 0.242) 


(d) D(2)= 12.21 


State-space methods for 
control system design 


8.1 The state-space-approach 


The classical control system design techniques discussed in Chapters 5—7 are gener- 
ally only applicable to 


(a) Single Input, Single Output (SISO) systems 
(b) Systems that are linear (or can be linearized) and are time invariant (have 
parameters that do not vary with time). 


The state-space approach is a generalized time-domain method for modelling, ana- 
lysing and designing a wide range of control systems and is particularly well suited to 
digital computational techniques. The approach can deal with 


(a) Multiple Input, Multiple Output (MIMO) systems, or multivariable systems 
(b) Non-linear and time-variant systems 
(c) Alternative controller design approaches. 


8.1.1 The concept of state 


The state of a system may be defined as: “The set of variables (called the state 
variables) which at some initial time to, together with the input variables completely 
determine the behaviour of the system for time £ > tp”. 

The state variables are the smallest number of states that are required to describe 
the dynamic nature of the system, and 1t is not a necessary constraint that they are 
measurable. The manner in which the state variables change as a function of time 
may be thought of as a trajectory in n dimensional space, called the state-space. 
Two-dimensional state-space is sometimes referred to as the phase-plane when one 
state 1s the derivative of the other. 
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8.1.2 The state vector differential equation 


The state of a system is described by a set of first-order differential equations in terms 
of the state variables (x;¡,x2,..., Xx») and input variables (u¡, u>,...,u,) in the 
general form 


dx; 

ar Y + 122 4 +00 inka + bi +>>+ + bimUm 

dx» 

ar — RIAL 222 4004 aX + b2141 ++** + amu (8.1) 
dx » É 

di = AniX1 + Ap2X2 + +++ 5 AnpXn + OnU1 + *** + OnmUm 


The equations set (8.1) may be combined in matrix format. This results in the state 
vector differential equation 


x = Ax + Bu (8.2) 
Equation (8.2) is generally called the state equation(s), where lower-case boldface 


represents vectors and upper-case boldface represents matrices. Thus 


x is the n dimensional state vector 


X1 
X2 
. (8.3) 
Xn 
u is the mm dimensional input vector 
ul 
un 
. (8.4) 
Um 
A is the n x n system matrix 
a11 01 +... dla 
21 02 +... 02; 
(8.5) 
Ant An... Ann 
B is the n x m control matrix 
bi sms Dim 
b>1 ... Dam 
y (8.6) 


Dni ... Dum 
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o 


(a) 


Fig. 8.1 Spring-mass—damper system and free-body diagram. 


In general, the outputs (y, y», ... 


variables and the input variables 


y = Cx + Du 


Equation (8.7) is called the output equation(s). 


Example 8.1 


Cy Ky 
yyy 
n | 
(b) 


, Jn) of a linear system can be related to the state 


(8.7) 


Write down the state equation and output equation for the spring-mass-damper 
system shown in Figure 8.1(a). 


Solution 
State variables 


Input variable 


Now 


From Figure 8.1(b) 


or 


P()- Ky-— Cy = my 


d?y A | 
= ) Y P 1 
d22 m? m? e 0 


(8.8) 


(8.9) 


(8.10) 


(8.11) 
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From equations (8.9), (8.10) and (8.11) the set of first-order differential equations are 


X1 = XM 
, K E 1 (8.12) 
X= X1 xa + —u 
m m m 
and the state equations become 
; 0 1 " 0 
Xi 1 
Ed =  K E HE 1 7) (8.13) 
m m m 
From equation (8.8) the output equation is 
y=[1 21] (8.14) 
X2 


State variables are not unique, and may be selected to suit the problem being studied. 
Example 8.2 
For the RCL network shown in Figure 8.2, write down the state equations when 


(a) the state variables are v2(1) and v, 
(b) the state variables are vaz(1) and i(1). 


Solution 
a 
(2) x1 = va(t) 
; E (8.15) 
x= =X1 
From equation (2.37) 
d?y, dv, 
LEO TA REG v, = vi(%) (8.16) 
From equations (8.15) and (8.16) the set of first-order differential equations are 
X1 =2%2 
1 RC 1 
X= X1 Xx) + u (8.17) 


v,(0) 0) C va(1) 


1 


Fig. 8.2 RCL network. 
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and the state equations are 


a) S [ete a] E pe al (8.18) 


LEC E C 
(b) Mm =vA0) (8.19) 
x2 = 1(t) : 
From equations (2.34) and (2.35) 
a = —»20) RIO + vi(0) (8.20) 
d 
ea = ¡(0) (8.21) 


Equations (8.20) and (8.21) are both first-order differential equations, and can be 
written in the form 


h 1 
X1=54X2 
(8.22) 


giving the state equations 
E 0 1 > 0 
Lp 1 
E Ed AR + 1fu (8.23) 
L L L 
Example 8.3 


For the 2 mass system shown in Figure 8.3, find the state and output equation when 
the state variables are the position and velocity of each mass. 


Solution 
State variables 


X1=Y1 M2=Y1 
X3=Y2 X4= Y2 
System outputs 
Y1) 2 
System inputs 
u = P(t) (8.24) 


For mass m; 


puts =mjY1 


Kaly =y1)= Kiyi + P(0) — Ci) =m)Y1 (8.25) 
For mass m», 


do F, = M2) 


— Kaya — y1) = M2JY2 (8.26) 
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LLEBRS LILILII11IL 


E 


t er 
y,( | a m, [A 


Y2>Y; 
ya ma m, | Ya, Yo, Y2 
(a) (b) 
Fig. 8.3 Two-mass system and free-body diagrams. 


From (8.24), (8.25) and (8.26), the four first-order differential equations are 


Xi = X 
A ( Ki ) Ci K, 1 
Xa = X1 Xx2+ Xx3 7 u 
mi m; mi mi mi (8.27) 
X3= XA 
K) K) 
Xa = — X1 — —X3 
1145) Mo 
Hence the state equations are 
0 1 0 0 
S E 1%) Cc E pl[x ; 
Xx | m; Mm Mm; X2 == 
ía | 7 0 0. 0 1] +[mi e 
K K 
X4 2 0 25 X4 0 
ma ma 
and the output equations are 
X1 
Yi 100.0 X2 
o] = E o 1 0]|x idici 
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pl »| Dn sa +...+ bis + Do 43) » 
"aras +... + a,s+a, 
Fig. 8.4 Generalized transfer function. 
8.1.3 State equations from transfer functions 
Consider the general differential equation 
d”y ey dy qu! u du 
rd dp! | 01 q, +00) = Dar or + + br q + ou (8.30) 


Equation (8.30) can be represented by the transfer function shown in Figure 8.4. 
Define a set of state variables such that 


X1 = Xx 
X2 = X3 
(8.31) 
Xp = —49X1 — 01X2 —*** — Op_1Xp +4 
and an output equation 
y =bo0x1 + b1Xx2 +++ +0p-1Xp (8.32) 
Then the state equation is 
Xi 0 1 0-0... 0 X1 0 
X2 0 0 Ln 0 X2 0 
: = : : +|: Ju (8.33) 
Xn-1 0 0 0-0... 1 di 0 
Xn =dy >=4 —=02 ... —Op-1 Xi 1 


The state-space representation in equation (8.33) is called the controllable canonical 
form and the output equation is 


y= [bo bi ba Da B-1] Xx3 (8.34) 


Example 8.4 (See also Appendix 1, examp84.m) 
Find the state and output equations for 

4 
% +35 +65 +2 


Y 
y = 
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X1 0. 1.0 X1 0 
x|=.|0 0 1 x|+|0Ju (8.35) 
X3 2 6 -—3 X3 1 


Solution 
State equation 


Output equation 


Xi 
y=[4 0 0]|x (8.36) 
X3 
Example 8.5 
Find the state and output equations for 
Y 547544 
UN” s5432+65+2 


Solution 
The state equation is the same as (8.35). The output equation is 


Xx] 
y=[4 7 S]|x (8.37) 


X3 


8.2 Solution of the state vector differential equation 


Consider the first-order differential equation 


d 
Si =ax(0) + bulo) (8.38) 
where x(*) and u(t) are scalar functions of time. Take Laplace transforms 
sX(s) — x(0) = aX(s) + bU(s) (8.39) 
where x(0) is the initial condition. From equation (8.39) 
x(0) b 
X(s) = a 8.4 
(5) (s — a) tE (s— a) do a 
Inverse transform 
1] 
x(1) = e" x(0) +/ e=Dhu(T)dr (8.41) 
0 


where the integral term in equation (8.41) is the convolution integral and T is a 
dummy time variable. Note that 
27 k pk 


dit att 
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Consider now the state vector differential equation 
x = Ax + Bu 
Taking Laplace transforms 


sX(s) — x(0) = AX(s) + BU(s) 


(sI — AJX(s) = x(0) + BU(s) 
Pre-multiplying by (sI — Ay”! 
X(s) = (sI— Ay x(0) + (sI — A) 'BU(s) 
Inverse transform 
t 
x(1) = ex(0) + / eN DBU(dr 
0 


if the initial time is fp, then 


t 
x(1) = e 0x(0) + de exBu(r)dr 


Lo 


(8.43) 


(8.44) 


(8.45) 


(8.46) 


(8.47) 


The exponential matrix e in equation (8.46) is called the state-transition matrix O(r) 


and represents the natural response of the system. Hence 


D(s) = (sI— A)” 


D(1)= L UsSI—-AJ! =e* 
Alternatively 
2,2 AFk 


At 


Hence equation (8.46) can be written 


x(0) = 9(OXx(0) + / E D(1 — 7)Bu(r)dr 


(8.48) 


(8.49) 


(8.50) 


(8.51) 


In equation (8.51) the first term represents the response to a set of initial conditions, 


whilst the integral term represents the response to a forcing function. 


Characteristic equation 


Using a state variable representation of a system, the characteristic equation is given 


by 
[(sT= A)| =0 


(8.52) 
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8.2.1 Transient solution from a set of initial conditions 


Example 8.6 
For the spring-mass—-damper system given in Example 8.1, Figure 8.1, the state 
equations are shown in equation (8.13) 


; 0 1 0 
[3]- [2 Ec] Eje. as 
m m m 


Given: m= 1kg, C= 3Ns/m, K=2N/m, u(t) =0. Evaluate, 

(a) the characteristic equation, its roots, w, and ( 

(b) the transition matrices p(s) and p(1) 

(c) the transient response of the state variables from the set of initial conditions 
y(0)=1.0, 
y(0) =0 


Solution 
Since x; = y and x> = y, then x,(0) =1.0, x2(0) =0. 
Inserting values of system parameters into equation (8.53) gives 


1% Alle] 


co o ao da si 
de 1-4) =|; >] - E 2 J=L cal 509 


From equation (8.52), the characteristic equation is 
[GT — A) =5(s+3)-(22)=5+35+42=0 (8.55) 
Roots of characteristic equation 
s=-1,-2 (8.56) 


Compare equation (8.55) with the denominator of the standard form in equation 
(3.43) 


W4=2 ie n= 1.414rad/s 


, (8.57) 
20 =3 1e C(=1.061 
(b) The inverse of any matrix A (see equation A2.17) is 
Adjoint A 
AU AA 8.5 
det A 9 


From equation (8.48) 
D(s) = (sI— Ay” 
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Using the standard matrix operations given in Appendix 2, equation (A2.12) 


Minors of Q(s) = [añ Al 


Co-factors of D(s) = le E 3) | 


The Adjoint matrix is the transpose of the Co-factor matrix 


Adjoint of D(s) = es | (8.59) 
Hence, from equations (8.58) and (8.48) 
(s +3) 1 
Ds) = (s+ DG +2) (s+ 0 +2) (8.60) 


(s+ D(s+2) (s+ Ds +2) 
Using partial fraction expansions 
1 1 
( +1 s+ 5) 


baba) 
D(s) = s+1 s+2 


> 1 1 1 ss 2 00) 
s+1 s+2 s+1 s+2 
Inverse transform equation (8.61) 
Qe* Je e?) (07! _ e?) 
D(1) pu Pene e e?) (=e* EN 2e?) (8.62) 


Note that the exponential indices are the roots of the characteristic equation (8.56). 


(c) From equation (8.51), the transient response is given by 


x(0) =2(0x(0) (8.63) 
Hence 
al le E= 20) (e —e2) 1 
El E ene ER e?) (=e* + | o] (8.64) 


x1(0)= (Qe —e?) 


x2(t) = —2(e* = e (8.65) 


The time response of the state variables (1.e. position and velocity) together with the 
state trajectory is given in Figure 8.5. 


Example 8.7 
For the spring-mass—-damper system given in Example 8.6, evaluate the transient 
response of the state variables to a unit step input using 


(a) The convolution integral 
(b) Inverse Laplace transforms 


Assume zero initial conditions. 
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Xol1) 


Rx 
po 
= 
=> 
- 
sa 


x(1) 


(a) (b) 
Fig. 8.5 State variable time response and state trajectory for Example 8.4. 
Solution 


(a) From equation (8.51) 


1 0 
E 0 óu(t—=7) Put 7) 
x(1) = D(1) o] + / bo ales kl al u(r)d7 (8.66) 
m 
Given that u(t) = 1 and 1/m= 1, equation (8.66) reduces to 


_fFlón(t—-7) 
xo = La 


Inserting values from equation (8.62) 


Í e (1-7) NN e At7) 
xo =/ A dr (8.67) 
Integrating 
e7lior) _ 12m]! 
x(1) = : (8.68) 
e7(t—7) + 627) ñ 


Inserting integration limits (T = t and 7 = 0) 


ES a ¡Ac (8.69) 
X2 el —eg2 


(b) An alternative method is to inverse transform from an s-domain expression. 
Equation (8.45) may be written 


X(s) = D(s)x(0) + D(s)BU(s) (8.70) 
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MODA rene reno ron rra Xo(t) 


sl Aj O 


Fig. 8.6 State variable step response and state trajectory for Example 8.5. 


2 1 1 1 
s+1 s+2 s+1 s+2 
1 1 -1 2 
2 
(+ +3) (+3) 


1 A 2 ) 
X(s) = sÚs ie 2 dl 2) (8.72) 


s(s+ Du.) 


Hence from equation (8.61) 


X(s) = 0% a HE (8.71) 


Simplifying 


Inverse transform 


_eon_1(1_e2 
x(1) = ' aid l (8.73) 
(1 e) +(1 e?) 
which gives 
Mp A 8.74 
El o ele (519) 


Equation (8.74) is the same as equation (8.69). 
The step response of the state variables, together with the state trajectory, is shown 
in Figure 8.6. 


8.3 Discrete-time solution of the state vector 
differential equation 


The discrete-time solution of the state equation may be considered to be the vector 
equivalent of the scalar difference equation method developed from a z-transform 
approach in Chapter 7. 
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The continuous-time solution of the state equation is given in equation (8.47). If 
the time interval (£— tp) in this equation is 7, the sampling time of a discrete-time 
system, then the discrete-time solution of the state equation can be written as 


T* 
x[(k + 1)7] = e*x(kT) + [ il ¿Bar Pue) (8.75) 
0 


Equation (8.75) can be written in the general form 
x[(k + 17] = A(Dx(K«T) + B(Du(kT) (8.76) 
Note 
AT)AHA and B(T)%B 


Equation (8.76) is called the matrix vector difference equation and can be used for the 
recursive discrete-time simulation of multivariable systems. 

The discrete-time state transition matrix A(T) may be computed by substituting 
T = t in equations (8.49) and (8.50), 1.e. 


A(T) = 0(T) =e*" (8.77) 
or 
NeT? AFP 
A TA (8.78) 


Usually sufficient accuracy is obtained with 5 < k < 50. 
The discrete-time control matrix B(T) from equations (8.75) and (8.76) is 


T 
B(T) = 0 e"Bdr (8.79) 


or 


AFT* 
ans (par 


Put T within the brackets 
Ar qe+! 
B(T) = (e + ip 


Hence 


AT?  A?T? AE 
pm (irá a epa (8.80) 


Example 8.5 (See also Appendix 1, examp88.m) 


(a) Calculate the discrete-time transition and control matrices for the spring-mass- 
damper system in Example 8.6 using a sampling time 7 = 0.1 seconds. 

(b) Using the matrix vector difference equation method, determine the unit step 
response assuming zero initial conditions. 
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Solution 
(a) The exact value of A(T) is found by substituting T' = £ in equation (8.62) 


(26701 — 2702) (6701 — 702) | 


A(T) = 0(T) = | 2(e 0l_e 02) ( e01 y 2e 0.2) 


ls cio 
0.172 0.733 


(8.81) 


An approximate value of A(T') is found from equation (8.78), taking the series as far 
as k= 2. 


ar=[ 0, 91, 


0.2 -—0.3 


AT o E O 7 04% -T=0:01 =0:015 
21. [-2 -3||-2 -3J1x2 | 0.03 0.035 


using the first 3 terms of equation (8.78) 


1.0 0 0.1 0.01 —0.015 
ES | 


0 1 0208 0.03 0.035 
0.99 0.085 

= | (8.82) 
0.17 0.735 


Since in equation (8.66), u(T) is unity, the exact value of B(T') can be obtained by 
substituting T = £ in equation (8.69) 


10 00 
Sia 
B(T) = | ÓN 0 | (8.83) 
B(T) = 0.00453 (8.84) 
[0.0861 
An approximate value of B(T) is found from equation (8.80), taking the series as far 
as k= 2. 
2 2773 
B(T) = (I1T)B + (5 )» ($ pe )» 
21 3! 
m | 0 ] A | 0.005 ] de loco! 
=Lo.1 0.015 0.00117 
0.0045 
= (8.85) 
0.08617 


(b) Using the values of A(T') and B(T) given in equations (8.81) and (8.84), together 
with the matrix vector difference equation (8.76), the first few recursive steps of 
the discrete solution to a step input to the system is given in equation (8.86) 
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kT=0 
x1(0.1)| [| 0.991 0.086 |[0 + 0.00453 1 0.00453 
x2(0.1)|  |—0.172 0.733||0 0.0861 |. — | 0.0861 
kT =0.1 
x1(0.2)| [| 0.991 0.086 | | 0.00453 dj 0.00453 1 0.016 
x2(0.2)|  |—0.172 0.733|| 0.0861 0.0861 |. — [0.0148 
kT =0.2 
x1(0.3)| [| 0.991 0.086 |[|0.016 EN 0.00453 1 0.033 (8.86) 
x2(0.3)|  |—0.172 0.733||0.148 0.0861 |. — |0.192 ó 
KT =0.3 
x1(0.4)| | 0.991 0.086 || 0.033 di 0.00453 di 0.054 
x2(0.4) |  |—0.172 0.733 ||0.192 0.0861 |. |0.227 
KT =0.4 
x1(0.5)| [| 0.991 0.086 || 0.054 de 0.00453 ls 0.078 
x2(0.5)| | —0.172 0.733 ||0.227 0.0861 |. [0.243 
Example 8.9 
A system has a transfer function 
Y 1 
NN ETT 


The system has an initial condition y(0) = 1 and is subject to a unit ramp function 
u(t) = t. Determine 


(a) The state and output equations 
(b) The transition matrix O(s) 
(c) Expressions for the time response of the state variables. 


Solution 
MONO 
y=[ 18] 
s+2 1 
1 a)-|€+DE+D EFDEFD 


(s+ Ds+D (s+ DG +1) 


xa] _ |30*4+2e*-2+1 
xo 2te +1-e" 


(c) | 
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8.4 Control of multivariable systems 


8.4.1 Controllability and observability 


The concepts of controllability and observability were introduced by Kalman (1960) 
and play an important role in the control of multivariable systems. 

A system is said to be controllable if a control vector u(z) exists that will transfer 
the system from any initial state x(t)) to some final state x(1) in a finite time interval. 

A system is said to be observable if at time tp, the system state x(tp) can be exactly 
determined from observation of the output y(t) over a finite time interval. 

If a system is described by equations (8.2) and (8.7) 


X= Ax + Bu 


os (8.87) 


then a sufficient condition for complete state controllability is that the n x n matrix 
M=I[B:AB:...:A7!B] (8.88) 


contains n linearly independent row or column vectors, i.e. is of rank n (that is, the 
matrix is non-singular, 1.e. the determinant is non-zero. See Appendix 2). Equation 
(8.88) is called the controllability matrix. 

The system described by equations (8.87) is completely observable if the nx n 
matrix 


N=|CTATCT:.. (ay CT] (8.89) 
is of rank n, 1.e. is non-singular having a non-zero determinant. Equation (8.89) is 


called the observability matrix. 


Example 5.10 (See also Appendix 1, examp8 10.m) 
Is the following system completely controllable and observable? 


3-0 
0 al 


Solution 
From equation (8.88) the controllability matrix is 


M = [B:AB] 


where 


hence 


M =[B:AB] = E al (8.90) 
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Equation (8.90) is non-singular since it has a non-zero determinant. Also the two row 
and column vectors can be seen to be linearly independent, so it is of rank 2 and 
therefore the system is controllable. 

From equation (8.89) the observability matrix is 


N= |[C*:A*C*] 
where 
Tpr_[-2 31[1]_T[-5 
e E 
hence 
N=[Ctiater]= |, EJ) (8.91) 


Equation (8.91) is singular since it has a zero determinant. Also the column vectors 
are linearly dependent since the second column is —5 times the first column and 
therefore the system is unobservable. 


8.4.2 State variable feedback design 


Consider a system described by the state and output equations 


X= Ax + Bu 
(8.92) 
y = Cx 
Select a control law of the form 
u =(r—-Kx) (8.93) 


In equation (8.93), r(1) is a vector of desired state variables and K is referred to as the 
state feedback gain matrix. Equations (8.92) and (8.93) are represented in state 
variable block diagram form in Figure 8.7. 
Substituting equation (8.93) into equation (8.92) gives 
Xx = Ax + B(r — Kx) 
or 
Xx = (A — BK)x + Br (8.94) 


In equation (8.94) the matrix (A — BK) is the closed-loop system matrix. 
For the system described by equation (8.92), and using equation (8.52), the 
characteristic equation is given by 


((sT— A)| =0 (8.95) 


The roots of equation (8.95) are the open-loop poles or eigenvalues. For the closed- 
loop system described by equation (8.94), the characteristic equation is 


((sT— A + BK)| =0 (8.96) 


The roots of equation (8.96) are the closed-loop poles or eigenvalues. 
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Fig. 8.7 Control using state variable feedback. 


Regulator design by pole placement 

The pole placement control problem is to determine a value of K that will produce 
a desired set of closed-loop poles. With a regulator, r(t) = 0 and therefore equation 
(8.93) becomes 


u= —Kx 


Thus the control u(z) will drive the system from a set of initial conditions x(0) to a set 
of zero states at time 1, 1.e. x(11) =0. 
There are several methods that can be used for pole placement. 


(a) Direct comparison method: 1f the desired locations of the closed-loop poles 
(eigenvalues) are 


S=M1,8=09,...,58= Un (8.97) 
then, from equation (8.96) 


[sI A+ BK| = (5 — pu Xs — 112). (5 fin) (8.98) 
=S +0 157 + --+015+09 (8.99) 


Solving equation (8.99) will give the elements of the state feedback matrix. 


(b) Controllable canonical form method: The value of K can be calculated directly using 


k = [00 — 49:01 —42:...:0-2 — An-2:09-1 — An ¡JT! (8.100) 


where Tis a transformation matrix that transforms the system state equation into 
the controllable canonical form (see equation (8.33)). 


T=MW (8.101) 
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where M is the controllability matrix, equation (8.88) 


a 0 An-1 1 
da a3 1 0 
W = : (8.102) 
aa 1 ... 0. 0 
1 0... 0.0 


Note that T=1I when the system state equation is already in the controllable 
canonical form. 


(c) Ackermann's formula: As with Method 2, Ackermann's formula (1972) is a direct 
evaluation method. It is only applicable to SISO systems and therefore u(t) and 
y(t) in equation (8.87) are scalar quantities. Let 


K=[0 0...0 1]M'4(A) (8.103) 

where M is the controllability matrix and 
AA) =A"+04 ¡A + +A + 091 (8.104) 
where A is the system matrix and a; are the coefficients of the desired closed-loop 


characteristic equation. 


Example 8.11 (See also Appendix 1, examp811.m) 
A control system has an open-loop transfer function 
1 
s(s +4) 
When x¡ = yand x, = x,,express the state equation in the controllable canonical form. 
Evaluate the coefficients of the state feedback gain matrix using: 


Y 
yo = 


(a) The direct comparison method 
(b) The controllable canonical form method 
(c) Ackermann's formula 


such that the closed-loop poles have the values 


s=-2,s=-2 
Solution 
From the open-loop transfer function 
y+4y=u (8.105) 
Let 
x= (8.106) 
Then 
X1 = X2 


(8.107) 
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Equation (8.106) provides the output equation and (8.107) the state equation 
0 


ap no 1 
2 100.4 


y=[1 


El 


o) 


1 


The characteristic equation for the open-loop system is 


s 0 0 1 
ral= Ilo JLo 4) 
0 s 0 -—4 


Thus 


aj =4, 


da=0 


The required closed-loop characteristic equation is 


(s+21(s+2) =0 


or 
s? + 45 4 
1.e. 
sE Q1S- 
hence 
q = 4, 


4=0 
HaY=0 
o =4 


Ss 


Ss 


2 


2 


po 


-4s +0 


Pas +0 


(a) Direct comparison method: From equations (8.99) and (8.111) 


IsI— A + BK] = 5? + 45 +4 


s 0 0 0 
R ¿|- Lo 24 + [Jue 
| 0.0 
Lo sele el 
Ss —1 
ki s+4+k) 


*+(4+k,3)5+k 


From equation (8.114) 


ki =4 
(4+ ko) =4 


Le. k2=0 


se +45+4 
s? +45+4 
3? +45+4 
s +45+4 


(8.108) 


(8.109) 


(8.110) 


(8.111) 


(8.112) 


(8.113) 


(8.114) 


(8.115) 
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(b) Controllable canonical form method: From equation (8.100) 


K = [0% = (dp :Q]— aj]T7! 


=[4-0:4-4]T”! 
=[4 0]Tr! (8.116) 
now 
T=MW 
where 
M=[B:AB] 
o 170 1 
alo a) |) 
giving 
m=| E] (8.117) 


Note that the determinant of M is non-zero, hence the system is controllable. 
From equation (8.102) 


Hence 


o 1 4 1 1.0 
re? Lao 


Thus proving that equation (8.108) is already in the controllable canonical form. 
Since T”! is also I, substitute (8.118) into (8.116) 


K=[4 0JI=[4 0] (8.119) 
(c) Ackermann's formula: From (8.103) 


K=[0 1]M"o(A) (8.120) 
From (8.117) 


LONA 
m7 EL al (8.121) 


From (8.104) 


HA) =A? + aJA + al 
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inserting values 


Ñ AÑ 1 q 
ici aaa 
l E y A h , 
= + 
0 16 0 16 0 4 
ER 8.122 
10.4 E 


Insert equations (8.121) and (8.122) into (8.120) 


4 1114 0 
$0 Ub oo al 


Ses 
=10 101, 4 


K=[4 0] (8.123) 


These results agree with the root locus diagram in Figure 5.9, where K = 4 produces 
two real roots of s = —2, s = —2 (1.e. critical damping). 


8.4.3 State observers 


In section 8.4.2 where state feedback design was discussed, it was assumed that all the 
state variables were available for the control equation (8.93) for a regulator 


u = (r—Kx) 
when r =0 
u = —Kx (8.124) 


Equations (8.124) requires that all state variables must be measured. In practice this 
may not happen for a number of reasons including cost, or that the state may not 
physically be measurable. Under these conditions it becomes necessary, if full state 
feedback is required, to observe, or estimate the state variables. 

A full-order state observer estimates all of the system state variables. If, however, 
some of the state variables are measured, it may only be necessary to estimate a few 
of them. This is referred to as a reduced-order state observer. All observers use some 
form of mathematical model to produce an estimate X of the actual state vector x. 
Figure 8.8 shows a simple arrangement of a full-order state observer. 

In Figure 8.8, since the observer dynamics will never exactly equal the system 
dynamics, this open-loop arrangement means that x and X will gradually diverge. If 
however, an output vector y is estimated and subtracted from the actual output 
vector y, the difference can be used, in a closed-loop sense, to modify the dynamics of 
the observer so that the output error (y — y) is minimized. This arrangement, some- 
times called a Luenberger observer (1964), is shown in Figure 8.9. 


State-space methods for control system design 255 


» 


Observer 


Fig. 8.8 A simple full-order state observer. 


Let the system in Figure 8.9 be defined by 
x = Ax + Bu (8.125) 
y =Cx (8.126) 
Assume that the estimate X of the state vector is 
Xx = Ax + Bu + K.(y — Cx) (8.127) 


where K. is the observer gain matrix. 
If equation (8.127) is subtracted from (8.125), and (x — X) 1s the error vector e, then 


e = (A — K.C)e (8.128) 
and, from equation (8.127), the equation for the full-order state observer is 
X = (A — K¿C)X + Bu + K.y (8.129) 


Thus from equation (8.128) the dynamic behaviour of the error vector depends upon 
the eigenvalues of (A — K.C). As with any measurement system, these eigenvalues 
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y 
u + Xx x 
> OB e => 
+ 
System 
A «== 
+ 
Ko 
+ X X 6 
pl a e O y 
Observer 
A E AX 


Fig. 8.9 The Luenberger full-order state observer. 


should allow the observer transient response to be more rapid than the system itself 
(typically a factor of 5), unless a filtering effect is required. 

The problem of observer design is essentially the same as the regulator pole 
placement problem, and similar techniques may be used. 


(a) Direct comparison method: 1f the desired locations of the closed-loop poles 
(eigenvalues) of the observer are 
S=PM1,5=P9,...,8 == En 
then 
[sI — A + K¿C| = (s — Ms — po)... .(s — pun) 
=S+opnas + -+0948+ 09 (8.130) 
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(b) Observable canonical form method: For the generalized transfer function shown 
in Figure 8.4, the observable form of the state equation may be written 


Es 0.0...0 -a7[x bo 
de 1.0...0 -a ||x by 
. + u 
Xn 0 0 ... 1 —4An-1 Xn bp: (8.131) 
X] 
X2 
y=[0 0...0 1]|. 
Xn 


Note that the system matrix of the observable canonical form is the transpose of the 
controllable canonical form given in equation (8.33). 
The value of the observer gain matrix K, can be calculated directly using 


Q0= 4 
Qq1 = (1 
K.=0 (8.132) 
QOn—-1 — An-1 


Q is a transformation matrix that transforms the system state equation into the 
observable canonical form 


Q = (WN)! (8.133) 
where W is defined in equation (8.102) and N is the observability matrix given in 
equation (8.89). If the equation is in the observable canonical form then Q = IL 


(c) Ackermann's formula: As with regulator design, this is only applicable to systems 
where u(t) and y(t) are scalar quantities. It may be used to calculate the observer 
gain matrix as follows 


K.=AA)IN" [0 0...0 1] 


or alternatively aj 


C 0 
CA 0 

K. = (A) : E (8.134) 
CA”! 1 


where ¿(A) is defined in equation (8.104). 


Example 5.12 (See also Appendix 1, examp812.m) 
A system is described by 


aJ= [2 La) + bf 
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Design a full-order observer that has an undamped natural frequency of 10 rad/s and 
a damping ratio of 0.5. 


Solution 
From equation (8.89), the observability matrix is 


N= [C": ATC" E o el (8.135) 
N is of rank 2 and therefore non-singular, hence the system 1s completely observable 
and the calculation of an appropriate observer gain matrix K. realizable. 
Open-loop eigenvalues: 


SIA] =57+354+2=5? +15 +0 (8.136) 
Hence 
d=2, a=3 
And the open-loop elgenvalues are 
s+35+2=0 
(s+ 1(5+2) =0 
s=-1l, s=-2 (8.137) 


Desired closed-loop eigenvalues: 
+ 2uns+ 0% =0 
s +105+100=5?+015+ 09) =0 (8.138) 


Hence 
ay =100, ay =10 
and the desired closed-loop eigenvalues are the roots of equation (8.138) 
pu = —5+)38.66, po =-—5-— 38.66 (8.139) 


(a) Direct comparison method: From equation (8.130) 


[sI A+ K.C] = s? +01+0 


s 0 0 1 Ke 
- - [1 0] =s?+105+ 100 
0 Ss —2 -3 e2 
Ss —-1 Ke1 0 
- = ++ 105 + 100 
2 5+3 Ko 0 
s+ka  —1 
=$ + 105 + 100 
2+ Ke2 s+3 


S* +(3 + ke1)s + Bke +2 +ke2) = 5? + 105 + 100 (8.140) 
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From equation (8.140) 
GB+kea)=10, ka =7 (8.141) 


Bke +2 + ke2) = 100 
ke = 100-221 =77 (8.142) 


(b) Observable canonical form method: From equation (8.132) 


98 
= o| | (8.143) 
7 
From equation (8.133) 
Q =(WN')”" 
and from equation (8.102) 
_ ¡jaj 1 3 1 
w=|3 o =k ol (8.144) 
Since from equation (8.135) 
1.0 T_ |1.0 
Nal el N le : (8.145) 
Thus 
1 [13 1[|1 0| [3 1 
WN" = E ollo a = É 0 (8.146) 
and 
1[fo —1] [O 1 
e= 2 3 =l; »| e 
Since Q 4 I then A is not in the observable canonical form. 
From equation (8.143) 
0 11/98 7 
Re 


(c) Ackermann's Formula: From (8.134) 


1 
K.=ó4)| ¿a | 1 
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Using the definition of p(A) in equation (8.104) 


-1 
K. (bad +00) 2] H (8.149) 


AA 
AAA 


98 71[0 7 
PIE 00 
14 77]L1 77 
8.4.4 Effect of a full-order state observer on a closed-loop 
system 


Figure 8.10 shows a closed-loop system that includes a full-order state observer. In 
Figure 8.10 the system equations are 


x = Ax + Bu 
y =Cx (8.151) 
The control is implemented using observed state variables 
u = —Kx (8.152) 
If the difference between the actual and observed state variables is 
e(1) = x(0) — X(0) 
then 
X(0) = x(0) — elt) (8.153) 
Combining equations (8.151), (8.152) and (8.153) gives the closed-loop equations 
Xx = Ax — BK(x-— e) 
= (A — BK)x + BKe (8.154) 
The observer error equation from equation (8.128) is 
e = (A — K.Cje (8.155) 
Combining equations (8.154) and (8.155) gives 


Xx A — BK BK 5 
| =| 0 Men (8.156) 


Equation (8.156) describes the closed-loop dynamics of the observed state feedback 
control system and the characteristic equation is therefore 


IsIA + BK||sI — A + K¿C| =0 (8.157) 
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System 


r=0 + y x=AaxBul Y 
ds y = Cx 


Ko 


Full-Order 
Observer 
A t= 


» 


Fig. 8.10 Closed-loop control system with full-order observer state feedback. 


Equation (8.157) shows that the desired closed-loop poles for the control system are 
not changed by the introduction of the state observer. Since the observer is normally 
designed to have a more rapid response than the control system with full order 
observed state feedback, the pole-placement roots will dominate. 

Using the state vectors x(1) and X(+) the state equations for the closed-loop system 
are 

From equations (8.151) and (8.152) 


x= Ax — BKx (8.158) 
and from equation (8.129) 


X = (A — K¿C)X — BKx + K¿Cx 
= (A -— K.C — BK)X + K.Cx 


(8.159) 


Thus the closed-loop state equations are 


E A —BK x 
H - E ll E (8.160) 
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8.4.5 Reduced-order state observers 


A full-order state observer estimates all state variables, irrespective of whether they 
are being measured. In practice, 1t would appear logical to use a combination of 
measured states from y = Cx and observed states (for those state variables that are 
elther not being measured, or not being measured with sufficient accuracy). 

If the state vector 1s of nth order and the measured output vector is of mth order, 
then it is only necessary to design an (n — m)th order state observer. 

Consider the case of the measurement of a single state variable x¡(*). The output 
equation is therefore 


y=x=Cx=[1! 0... 0]x (8.161) 
Partition the state vector 
_ | XA 
x= E (8.162) 


where x, are the state variables to be observed. 
Partition the state equations 


ESSE di 
If the desired eigenvalues for the reduced-order observer are 
S = [lle S = M0) ---> 8 = Mn—=De 
Then it can be shown that the characteristic equation for the reduced-order observer is 
[sI — Aj + K¿Ajo] = (5 — pure) - - -(S — Mn—1ye) 
= + om +++ + 1105 + Os (8.164) 


In equation (8.164) A¿. replaces A and Aj. replaces C in the full-order observer. 
The reduced-order observer gain matrix K. can also be obtained using appropriate 
substitutions into equations mentioned earlier. For example, equation (8.132) 


becomes 
Ave — Uoe 
Ale — Ale 
K. =Q. 2 (8.165) 
O(n—2)e — A(n—2)e 
Where 4oe, ..., A(n-2)0 are the coefficients of the open-loop reduced order character- 


istics equation 
IsT— Ace] =8"* + Ane? + a108 + oe (8.166) 
and 


Q. = (WeNI)' (8.167) 
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where 
a1 40 ... dn-2 1 
10) aa. 1 0 
W, = : (8.168) 
UAn—2 1...0 0 
1 0...0 0 
and 
N. = (AT. ASFALTO) AA (8.169) 
and Ackermann's formula becomes 
Ále E 0 
AtAce 0 
K. = H(Av.) : ; (8.170) 
Aj At? 0 
Ar Ajo” l 
where 
HA ce) = AM + 0 A 007 4 +++ + 09Ac0 + a] (8.171) 
Define 
al =X — K.y 
Then 
X =Xe1 —- Key (8.172) 


The equation for the reduced-order observer can be shown to be 
al = (AceKA joer E [A¿¡Koa11 ÍA (Ace 5 K.A¡o)K.) y le (Bo NN K.b¡)u (8.173) 


Figure 8.11 shows the implementation of a reduced-order state observer. 
Case study 


Example 8.13 (See also Appendix 1, examp813.m) 
(a) In case study Example 5.10 a control system has an open-loop transfer function 


1 
G(sSH(s) = G+DGFS 
The controller was a PD compensator of the form 
G(s) = K¡(s + a) 
With K, = 15 and a= 1, the system closed-loop poles were 
s =-3.132 + j3.253 


s = 0.736 
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System 


r=0 S Y pl x=Ax+Bu ita 


y = Cx 


Aa — Kan lan—oe 


Reduced-Order 
Observer 


- KoAro 


T 
1 
) 
1 
1 
Yo o sl 
Xa Av 
1 
1 
1 
1 
1 
1 
1 
1 


Fig. 8.11 Implementation of a reduced-order state obse 


with the resulting characteristic equation 


e +75 +25 


rver. 


+15=0 


Demonstrate that the same result can be achieved using state feedback methods. 


(b) Design a reduced second-order state obs 


erver for the system such that the poles 


are a factor of 10 higher than the closed-loop system poles, 1.e. 


s =-—31.32 4 


E 532.53 


which correspond to w, = 45.16 rad/s and ( = 0.7. 


Solution 


1 


(a) G(s)H(s) = 


s3 +78? + 10s+ 0 
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From equations (8.33) and (8.34) 


0: 1 0 0 
A PR 
0:-10 -7 1 


Open-loop characteristic equation 


e +7 +105+0=0 
(8.175) 
S+am7+as+a=0 
Closed-loop characteristic equation 
+7 +255+15=0 
(8.176) 
+0 +00s+0=0 


Using direct comparison method 


IsI— A + BK| =5 +75 +255+ 15 
s 0.0 0 1 0 0 
0 s 0|-|0 0 1 |+|0|[k ko k3]=s5 +75 +255+15 
0.0 s 0 -10 -—7 1 
s —l 0 0.0.0 
0 s -1[|+|0 0 0||=5 +75 4+255+15 
0 10 s+7 Ki kz K3 
Ss -1 0 
0 $ -1 =3 +75 4+255+ 15 
ki 10+k s+7+k3 
(8.177) 
Expanding the determinant in equation (8.177) gives 
ki=15, k2=15, k3=0 
Hence 
X1 
u=-[15 15 IN (8.178) 
X3 


since xz = X1, this is identical to the original PD controller 
G(s) = 15(s+ 1) 


Although the solution is the same, the important difference is with state feedback, the 
closed-loop poles are placed at directly the required locations. With root locus, a 
certain amount of trial and error in placing open-loop zeros was required to achieve 
the desired closed-loop locations. 
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(b) Reduced-order state observer: Partitioning the system equation A in (8.174) and 
inserting in equation (8.164) 


Ss 0 0 1 Ke 
Z AE [1 0]| =3?+ 2605 + ww? 
0 Ss —10 7 Keo 
Ss —1 Ke 0 
+ = $? + 63.25 + 2039.4 
10 s+7 ko 0 
S+Kke1 —1 
= $? + Q1eS + Ade 
10 + Ke s+7 
S*+(7+keo1)s + (Tke1 + 10 + ko2) = 8? + 63.25 + 2039.4 (8.179) 


Equating coefficients in equation (8.179) 


(7+ ka) =63.2. ka =56.2 (8.180) 


(1 x 56.2 + 10+ ke) = 2039.4 
Kke> = 1636 (8.181) 
Referring to Figure 8.11 and partitioned systems (8.174) and (8.163) 


0 56.2 0 
B. — K.b¡ = e 0= 
1 1636 1 


0 56.2 0 
A a lla lees 0= (8.182) 
0 1636 0 
0 1 56.2 56.2 1 
Av — K.Ajo = 2 [1 0] => 
10 -—7 1636 —1646 -—7 


Inserting equation (8.182) into Figure 8.11 gives the complete state feedback and 
reduced observer system shown in Figure 8.12. 

Comparing the system shown in Figure 8.12 with the original PD controller given 
in Example 5.10, the state feedback system may be considered to be a PD controller 
where the proportional term uses measured output variables and the derivative term 
uses observed state variables. 


8.5 Further problems 


Example 8.14 
For the d.c. motor shown in Figure 4.14, the potential difference across the armature 
winding is given by equation (4.21) 

di 


24 Raialt) 


ea(1) pS ep(1) = La dí 
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System 


X 010|x|Jj0 


X3 0-10-—7 X3 1 


0 

1 

Xar + 

0 

' ¡é > 
Ú / 0 
0 
“ Reduced-Order 

Observer 


A 


Fig. 8.12 Complete state feedback and reduced observer system for case study Example 8.11. 


where, from equation (4.20) 


dó 
= K.— 
ep(1) > 


and the torque Tim(t) developed by the motor is given by equation (4.18) 
Tmn(0) —= Kaia(t) 


If the load consists of a rotor of moment of inertia / and a damping device of 
damping coefficient C, then the load dynamics are 


do ¡$9 
di “de 


where 0 is the angular displacement of the rotor. 


TE 
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(a) Determine the state and output equations when the state and control variables 
are 


X1 =0, Xa =X1, X3 = la, U = la 


(b) Determine the state and output equations when the state and control variables 
are 


x¡=0, 


X2=X1, X3=X2 U=€a 
Solution 
(a) 0 1 0 
a a e a e 
. 0 -—= — 0 
X2 I I Xx |+ pp 
AN PE 
La La 
6=[1 O 0]x 
(b) 0 1 0 0 
de 0 0 1 app 
Xx XxX u 
ÉS 0 (K¿Kp + RaC) Ra as C a Ka 
: Ed la E ] Lal 
6=[1 O 0]x 
Example 8.15 


Find the state and output equations for the positional servomechanism shown in 
Figure 8.13 when the state and control variable are 


x1=C(0), x2=X,, u=r(í) 
Solution 

E e Te fo 
l=l £ Cc +1klu 
me m mi LY m 
c=[1 O0Ix 

Rs + C(s 

o Os) » dl » E pl 


Fig. 8.13 Block diagram of positional servomechanism. 
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4(s+4) 40 C(s) 


É (s+16) 


Fig. 8.14 Closed-loop control system. 


Example 8.16 
Find the state and output equations for the closed-loop control system shown in 
Figure 8.14 when the state and control variables are 


x1=Cl[b), X2=X1, X3=X>, u=r(t) 
Solution 

X1 0 1 0 X1 0 

Xx |= 0 0 1 xi+|0Ju 

X3 640 -192 18| | x3 1 


c=[640 160 0I]x 


Example 8.17 

Figure 8.15 shows the block diagram representation of a car cruise control system 
where U(s) is the desired speed, X(s) is the accelerator position and V(s) is the actual 
speed. 


(a) Find the state and output equations when the state and control variables are 
x1=x(0), x2=vV(0), u=u() 


(b) Determine the continuous-time state transition matrix D(1). 
(c) For a sampling time of 0.1 seconds, evaluate from Q(1) the discrete-time state 
transition matrix A(T). 


Accelerator Servo Vehicle Dynamics 
us y 2 X(s) 3 V(s) 
A E Ss d (s+3) E 


Fig. 8.15 Car cruise control system. 
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(d) Using the first three terms of equation (8.80), compute the discrete-time control 
transition matrix B(7). Using the difference equations 


xX(k + 1)T = A(DIX(kT) + Bu(kT) 


determine values for the state variables when u(kT) is a piece-wise constant 
function of the form 


kT (sec) 0. 01 02 03 04 
UT) 10 15 20 25 30 


Assume zero initial conditions. 


Solution 
o[2-[S AJlo)" 
v=[0 1I]x 


21 
(b) D(1) == pe + e?) al 


0.819 0 
a lesa il 
0.181 
NAL ls. 
kT (see) 0. 01 02 0.3 0.4 
u(kT) 10 15 20 25 30 
X1 0 1.81 4.197 7.057 10.305 


X2 0 0.25 0.984 2.211 3.915 


Example 8.18 
The ship roll stabilization system given in case-study Example 5.11 has a forward- 
path transfer function 


dara K 
da GADEA 


(a) For the condition K=l, find the state and output equations when 
Xi = Palt), X2=X1,X3=X2 and u = Óa(0). 

(b) Calculate the controllability matrix M and the observability matrix N and 
demonstrate that the system is fully controllable and fully observable. 

(c) Determine the state feedback gain matrix K that produces a set of desired closed- 
loop poles 


s =-3.234 +33.3 
s=-3.2 
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(d) Find the observer gain matrix K. for a full-order state observer that produces a 
set of desired closed-loop poles 


s=-—16.15 +j16.5 
s=-—16 


(e) If output da(t) = x1 is measured, design a reduced-order state observer with 
desired closed-loop poles 


s=-—16.15 +316.5 


Solution 
X1 0 1 0 X1 0 
(a) |[x2|=.|0 0 1 xi+j|j0ju 
X3 2 -217 -—1.7 X3 1 
da =[1 0 0]x 
0 0 1 
(bp M=|0 1 —1.7 
1 -—17 0.19 


det(M) = —1, rank(M) = 3 
System fully controllable. 


1.0.0 
N=|0 1 0 
0 0 1 


det(N) = 1, rank(N) = 3 
System fully observable. 
(c) K=[66.29 39.34 7.968] 


(d) K. =[8527.2 1047.2 46.6] 
(e) K. =[530.3 30.6] 


Optimal and robust control 
system design 


9.1 Review of optimal control 


An optimal control system seeks to maximize the return from a system for the 
minimum cost. In general terms, the optimal control problem is to find a control u 
which causes the system 


X = g(x(0), u(o), £) (9.1) 


to follow an optimal trajectory x(1) that minimizes the performance criterion, or cost 
function 


t] 

J= / H(x(0), u(o), t)dt (9.2) 
0 

The problem is one of constrained functional minimization, and has several 

approaches. 

Variational calculus, Dreyfus (1962), may be employed to obtain a set of differ- 
ential equations with certain boundary condition properties, known as the Euler— 
Lagrange equations. The maximum principle of Pontryagin (1962) can also be 
applied to provide the same boundary conditions by using a Hamiltonian function. 

An alternative procedure is the dynamic programming method of Bellman (1957) 
which is based on the principle of optimality and the imbedding approach. The 
principle of optimality yields the Hamilton-Jacobi partial differential equation, 
whose solution results in an optimal control policy. Euler-Lagrange and Pontrya- 
gin's equations are applicable to systems with non-linear, time-varying state equa- 
tions and non-quadratic, time varying performance criteria. The Hamilton—Jacobi 
equation is usually solved for the important and special case of the linear time- 
invariant plant with quadratic performance criterion (called the performance index), 
which takes the form of the matrix Riccati (1724) equation. This produces an optimal 
control law as a linear function of the state vector components which is always stable, 
providing the system is controllable. 


9.1.1 Types of optimal control problems 


(a) The terminal control problem: This is used to bring the system as close as possible 
to a given terminal state within a given period of time. An example is an 
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automatic aircraft landing system, whereby the optimum control policy will focus 
on minimizing errors in the state vector at the point of landing. 

(b) The minimum-time control problem: This is used to reach the terminal state in the 
shortest possible time period. This usually results in a “bang-bang' control policy 
whereby the control is set to 4nax initially, switching to uni, at some specific time. 
In the case of a car journey, this is the equivalent of the driver keeping his foot 
flat down on the accelerator for the entire journey, except at the terminal point, 
when he brakes as hard as possible. 

(c) The minimum energy control problem: This is used to transfer the system from an 
initial state to a final state with minimum expenditure of control energy. Used in 
satellite control. 

(d) The regulator control problem: With the system initially displaced from equilib- 
rium, will return the system to the equilibrium state in such a manner so as to 
minimize a given performance index. 

(e) The tracking control problem: This is used to cause the state of a system to track 
as close as possible some desired state time history in such a manner so as to 
minimize a given performance index. This is the generalization of the regulator 
control problem. 


9.1.2 Selection of performance index 


The decision on the type of performance index to be selected depends upon the 
nature of the control problem. Consider the design of an autopilot for a racing yacth. 

Conventionally, the autopilot is designed for course-keeping, that is to minimise 
the error 4.(t) between that desired course 44(t) and the actual course 4, (1) in the 
presence of disturbances (wind, waves and current). Since 44(t) 1s fixed for most of 
the time, this is in essence a regulator problem. 

Using classical design techniques, the autopilot will be tuned to return the vessel on 
the desired course within the minimum transient period. With an optimal control 
strategy, a wider view is taken. The objective is to win the race, which means 
completing it in the shortest possible time. This in turn requires: 


(a) Minimizing the distance off-track, or cross-track error ye(t). Wandering off track 
will increase distance travelled and hence time taken. 

(b) Minimizing course or heading error ve(t). It is possible of course to have zero 
heading error but still be off-track. 

(c) Minimizing rudder activity, i.e. actual rudder angle (as distinct from desired 
rudder angle) 6,(1), and hence minimizing the expenditure of control energy. 

(d) Minimizing forward speed loss u¿(t). As the vessel yaws as a result of correcting 
a track or heading error, there is an increased angle of attack of the total velocity 
vector, which results in increased drag and therefore increased forward speed 
loss. 


From equation (9.2) a general performance index could be written 


1=] 10, Yelo), Uelt), Sa(1)d1 (9.3) 


0 
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Quadratic performance indices 
Tf, in the racing yacht example, the following state and control variables are defined 


X1 == Yel1), X2 == Vel), X3 => ut), u= da (1) 
then the performance index could be expressed 


11 
J= / [(quix1 + q22x2 + q33X3) + (ru) j dt (9.4) 
to 


Or 
J= J " (Qx + Rujd: (9.5) 


If the state and control variables in equations (9.4) and (9.5) are squared, then the 
performance index become quadratic. The advantage of a quadratic performance 
index is that for a linear system it has a mathematical solution that yields a linear 
control law of the form 


u(1) = -Kx(t) (9.6) 
A quadratic performance index for this example is therefore 
t1 
JS / Llana + 92293 + q33%3) + (riu?) Jar (9.7) 
to 
0 0 X1 


t q11 
1=] [xr x2 x3l1| 0 qm9 0 x2 | + [ullr; Ju] | de 
to 0 0 (33 X3 


or, in general 
tf 
J= J (x"Qx + u Rujdí (9.8) 
to 


Q and R are the state and control weighting matrices and are always square and 
symmetric. J is always a scalar quantity. 


9.2 The Linear Quadratic Regulator 
The Linear Quadratic Regulator (LQR) provides an optimal control law for a linear 


system with a quadratic performance index. 


9.2.1 Continuous form 


Define a functional equation of the form 


Fx, ) =min / j h(x, ud: (9.9) 


0 
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where over the time interval ty to t;, 


Fx, to) = f(x(0)) 


Hx,t1)=0 
From equations (9.1) and (9.2), a Hamilton—Jacobi equation may be expressed as 
a a T 
y = —min |/A(x, u) + y g(x, u) (9.10) 
Ot u Ox 


For a linear, time invariant plant, equation (9.1) becomes 
x = Ax + Bu (9.11) 


And if equation (9.2) is a quadratic performance index 


tf 
J= / (x"Qx +u' Rujd: (9.12) 
to 
Substituting equations (9.11) and (9.12) into (9.10) 
S q T 
qe —min [x"Qx+u'Ru+ Y (Ax + Bu) (9.13) 
Ot u OX 
Introducing a relationship of the form 
fA1=x"Px (9.14) 
where P is a square, symmetric matrix, then 
o 710 
—=x  _P 9.1 
Aa” ia 
and 
of 
0% = 2Px 
T 
El =2x"P (9.16) 
Ox 
Inserting equations (9.15) and (9.16) into (9.13) gives 
x! Es = —min[x"Qx + u' Ru + 2x"P(Ax + Bu)] (9.17) 
To minimize u, from equation (9.17) 
ur (90 TR +2xTPB=0 (9.18) 
u 


Equation (9.18) can be re-arranged to give the optimal control law 


Up: = —R'B*Px (9.19) 
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or 
Uop: = —Kx (9.20) 
where 
K=R "BP (9.21) 
Substituting equation (9.19) back into (9.17) gives 
x"Px = —x"(Q + 2PA — PBR 'B"P)x (9.22) 
since 
2x"PAx =x (ATP + PA)x 
then 
P=-PA-A'P-Q+PBR 'B'P (9.23) 


Equation (9.23) belongs to a class of non-linear differential equations known as the 
matrix Riccati equations. The coefficients of P(t) are found by integration in reverse 
time starting with the boundary condition 


x*(11)P(01)x(01) =0 (9.24) 


Kalman demonstrated that as integration in reverse time proceeds, the solutions of 
P(t) converge to constant values. Should 1, be infinite, or far removed from tp, the 
matrix Riccati equations reduce to a set of simultaneous equations 


PA+A'P+0Q -—PBR 'B'"P=0 (9.25) 


Equations (9.23) and (9.25) are the continuous solution of the matrix Riccati 
equation. 


9.2.2 Discrete form 
From equation (8.76) the discrete solution of the state equation 1s 
x[(x + 17] = ADKx(«T) + BD) u(k«T>) (9.26) 
For simplicity, if (kT') is written as (k), then 
x(k + 1) = A(D)x(k) + B(D)ju(k) (9.27) 


The discrete quadratic performance index is 
N-1 
J= >> A (9Qx() + u (1) Ru(k)T (9.28) 
k=0 


The discrete solution of the matrix Riccati equation solves recursively for K and P in 
reverse time, commencing at the terminal time, where 


KW - (+1) =[TR +BUDPW -— BD BUDPN — kA(T) (9.29) 


and 
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P(N — (k + 1) =[TQ + KUN — (k + 1)TRK(W — (k + 1))] +[A(7) 
— BDKN -—(k+ DIUPV —IO[A(T) — B(DK(V — (k + 1))] 


(9.30) 


As k is increased from 0 to N — 1, the algorithm proceeds in reverse time. When run 
in forward-time, the optimal control at step k is 


Uop(k) = —K(k)x(k) (9.31) 


The boundary condition is specified at the terminal time (k = 0), where 


xUNPWIX(N) =0 (9.32) 


The reverse-time recursive process can commence with P(V) = 0 or alternatively, 


with P(V— 1)= TQ. 


Example 9.1 (See also Appendix 1, examp91.m) 


The regulator shown in Figure 9.1 contains a plant that is described by 


4] [0  1][x E 0 
el" la ll e 
and has a performance index 


J 


l 
—, 
8 
AAA 
ES 
AAA 
Oo wv 
Ro 
A 
ES 
+ 
Ss 
ho 
(A 
a 


Determine 


(a) the Riccati matrix P 
(b) the state feedback matrix K 
(c) the closed-loop eigenvalues 


x= Ax+Bu 


Fig. 9.1 Optimal regulator. 
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Solution 


(a) 


2 0 
Q = R = scalar = 1 
0 1 


From equation (9.25) the reduced Riccati equation is 


PA+A'P+0Q-—PBR 'B'P=0 (9.33) 
0 1 S -2 
PA — la el | | _ | Pr Pr e] (9.34) 
Pa pall-1 -2 =pm Pam 2p2 
O -1 E - 
yt | | la a] E | P21 P22 | (9.35) 
1 —2]l|pa2 pz Pu=2pxm pi -— 2p2 


pu pa|[o0 Pu Pa 
PBR 'B'P = | | | E 0 | 
pam pa||1 Pa P2 


= 2 os p22] 
P22 


l 2P21 P12P22 | 


= > (9.36) 
papa Pz 
Combining equations (9.34), (9.35) and (9.36) gives 
dE Ppu= e | —Pa —P22 | 
=pm pa — 2p Ppu=2px pi -— 2p 
(9.37) 


2.0 Papa Papa| 0 
0 1 Papa Ps 
Since P is symmetric, pz, = pi2. Equation (9.37) can be expressed as four simultan- 
eous equations 


O (9.38) 


Pu — 2p1 — pa — pupa =0 (9.39) 
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—pa2 + pu — 2p1 — pr2pa2 =0 (9.40) 
po 2p2+pm-2p2+1-ph=0 (9.41) 
Note that equations (9.39) and (9.40) are the same. From equation (9.38) 
Pi +2pm=2=0 
solving 
Pr =p2=0.732 and -2.732 
Using positive value 
pr = pa = 0.732 (9.42) 
From equation (9.41) 


2p12 — 4pa2 +1 ph) =0 
Hós + 4p2, — 2.464 =0 


solving 
pa = 0.542 and -4.542 
Using positive value 
Pa = 0.542 (9.43) 
From equation (9,39) 


pu —Q x 0.732)-0.542 — (0.732 x 0.542) =0 
pu =2.403 (9.44) 


From equations (9.42), (9.43) and (9.44) the Riccati matrix is 


2.403 0.732 
= (9.45) 
0.732 0.542 
(b) Equation (9.21) gives the state feedback matrix 
2.403 0.732 
K=RUIB'P=1[0 1] (9.46) 
0.732 0.542 


Hence 


K=[0.732 0.542] 
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(c) From equation (8.96), the closed-loop eigenvalues are 


lsI— A + BK| =0 


s 0 0 1 0 
- + | |[0.732 0.542]|=0 
Os 0 1 
Meal 0 0 
+ =0 
19 0.732 0.542 


Ss —1 
1.732 5+2.542 
3 + 2.5425 + 1.732 =0 
51, 2 =—1.271 + j0.341 


=0 


In general, for a second-order system, when Q is a diagonal matrix and R is a scalar 


quantity, the elements of the Riccati matrix P are 
b3 
h 


Pu= | luna —= Po2da1 — P1240> 


r p?2 
PR=PA=p £. EY a3 + me (9.47) 


2 
2 


r 2 + 
A a, + Pr + q) 
b5 r 


9.3 The linear quadratic tracking problem 


The tracking or servomechanism problem is defined in section 9.1.1(e), and is directed 
at applying a control u(z) to drive a plant so that the state vector x(+) follows a desired 
state trajectory r(t) in some optimal manner. 


9.3.1 Continuous form 


The quadratic performance index to be minimized is 


J= / " [+ — xQ — x) +u"Ru] dí (9.48) 


0 


It can be shown that the constrained functional minimization of equation (9.48) 
yields again the matrix Riccati equations (9.23) and (9.25) obtained for the LQR, 
combined with the additional set of reverse-time state tracking equations 


¿=(A-—BR 'B'P)'s — Qr (9.49) 
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Optimal Controller 


Plant 
F E s v + Uopt x y 
Ep> s=(A-BR BP) s-Qr EH> -RTB' > x=Ax+Bu E co tE> 
Reverse-Time Equations e 
vector 
Tracking vector 
K 
Fig. 9.2 Optimal tracking system. 
where s is a tracking vector, whose boundary condition is 
s(t1)=0 (9.50) 
and the optimal control law is given by 
op; = —R'B'Px —R 7 B's 
If 
v=-—R'B's 
and 
K=R”'B'P 
Then 
opi = Y — Kx (9.51) 


Hence, if the desired state vector r(£) is known in advance, tracking errors may be 
reduced by allowing the system to follow a command vector v(t) computed in 
advance using the reverse-time equation (9.49). An optimal controller for a tracking 
system is shown in Figure 9.2. 


9.3.2 Discrete form 


The discrete quadratic performance index, writing (kT') as (k), is 
N-1 
J = Y [400 — x()) QU) — xo) + ()Ru()]7 (9.52) 
k=0 


Discrete minimization gives the recursive Riccati equations (9.29) and (9.30). These 
are run in reverse-time together with the discrete reverse-time state tracking equation 


S(N — (k + 1)) = E(DIS(N — ko) + G(T)r(N — k) (9.53) 
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having the boundary condition 
s(N)=0 


F(T) and G(T) are the discrete transition and control matrices and are obtained by 
converting the matrices in the continuous equation (9.49) into discrete form using 
equations (8.78) and (8.80). 

The command vector v is given by 


vY(N — k) = —R UB US(N — k) (9.54) 
When run in forward-time, the optimal control at time (XT) is 
Up AT) = (KT) — K(KT)x(KT) (9.55) 
The values of x(kT') are calculated using the plant state transition equation 


x( + 1)7 = A(T)X(KT) + B(T)00p(«T) (9.56) 


Example 9.2 (See also Appendix 1, examp92.m) 
The optimal tracking system shown in Figure 9.2 contains a plant that is described by 


els] 


The discrete performance index is 


200 


J=y rar) Xx KT) ART) — o) 


k=0 


10 Y a a ua A wr 
0 1] LrAkT)=xAKT) 


It is required that the system tracks the following desired state vector 


r(«T)]  [ LOsin(0.6284kT) 
(KT) | [| 0.6c05(0.6284kT) 


over a period of 0-20 seconds. The sampling time Tis 0.1 seconds. 

In reverse-time, starting with P(V) =0 at NT = 20 seconds, compute the state 
feedback gain matrix K(kT) and Riccati matrix P(kT) using equations (9.29) and 
(9.30). Also in reverse time, use the desired state vector r(kT') to drive the tracking 
equation (9.53) with the boundary condition s(V) = 0 and hence compute the com- 
mand vector v(kT). 

In forward-time, use the command vector v(kT') and state vector x(kT') to calculate 
Uopi( XT) in equation (9.55) and hence, using the plant state transition equation (9.56) 
calculate the state trajectories. 
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Solution 

The reverse-time calculations are shown in Figure 9.3. Using equations (9.29) and 
(9.30) and commencing with P(V) = 0, it can be seen that the solution for K (and also 
P) settle down after about 2 seconds to give steady-state values of 


K(«T) =[2.0658 1.4880] 


8.0518 mal (9.57) 


P(kT) = 
ad beses 1.6310 


Using equation (9.49), together with equations (8.78) and (8.80), to calculate F(T) 
and G(T) in equation (9.53), for T =0.1 seconds, the discrete reverse-time state 
tracking equation is 
si(N — (k+ 1) 
s2N — (k+ 1) 


0.9859 —0.2700 | | s (VW —k) 
0.0881 0.7668 s(N —k) 


[ot 0.0141 | IA 


0.0460 0.0881 | | ra(N— Lo 
and 
«N-=-10 103 | (9.58) 


Then the command vector v (in this case a scalar) is generated in reverse-time as 
shown in Figure 9.3. The forward-time response is shown in Figure 9.4. 


Desired states, Command Vector and Feedback Gains 


0 2 4 6 8 10 12 14 16 18 20 
Time (s) 


Fig. 9.3 Reverse-time solutions for a tracking system. 
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Desired States, Actual States and Optimal Control 


2 4 6 8 10 12 14 16 18 20 
Time (s) 


Fig. 9.4 Forward-time response of a tracking system. 


The optimal control is calculated using equation (9.55) and the values of the state 
variables are found using the plant state transition equation (9.56) 


al Lona mete | las bss 
= + 


= | UopKT) (9.59) 
xk +17 —0.0950 0.9002 | | x(kT) 0.0950 

where A(T) and B(T) are calculated from equations (8.78) and (8.80). From Figure 
9.4 1t can be seen that after an initial transient period, the optimal control law takes 
the form of a phase lead compensator. Because of the weighting of the Q matrix in 
the performance index, x¡(kT”) tracks r¡(kT'”) more closely than x2(kT') tracks ra(kT). 


9.4 The Kalman filter 


In the design of state observers in section 8.4.3, it was assumed that the measure- 
ments y = Cx were noise free. In practice, this is not usually the case and therefore 
the observed state vector X may also be contaminated with noise. 


9.4.1 The state estimation process 


State estimation is the process of extracting a best estimate of a variable from a 
number of measurements that contain noise. 

The classical problem of obtaining a best estimate of a signal by combining two 
noisy continuous measurements of the same signal was first solved by Weiner (1949). 
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His solution required that both the signal and noise be modelled as random process 
with known statistical properties. 

This work was extended by Kalman and Bucy (1961) who designed a state 
estimation process based upon an optimal minimum variance filter, generally 
referred to as a Kalman filter. 


9.4.2 The Kalman filter single variable estimation problem 


The Kalman filter is a complementary form of the Weiner filter. Let 4, be a 
measurement of a parameter x and let its variance P, be given by 


P.= E(A, .e Ay) (9.60) 


where 4, is the mean and Ef ] is the expected value. 
Let B, be a measurement from another system of the same parameter and the 
variance P) is 


P, = E[(B,— B,y”) (9.61) 
Assume that x can be expressed by the parametric relationship 
x= AyK + Bx(1 — K) (9.62) 


where K is any weighting factor between 0 and 1. The problem is to derive a value of 
K which gives an optimal combination of 4, and B, and hence the best estimate of 
measured variable x, which is given the symbol X (pronounced x hat). 

Let P be the variance of the weighted mean 


P=E[(x- 0%) (9.63) 
The optimal value of K is the one that yields the minimum variance, 1.e. 
dP 
ÓN 0 (9.64) 


Substitution of equation (9.62) into (9.63) gives 
P=XK?P4+(-KYPg (9.65) 
Hence K is given by 
d 
er U= KYP5) =0 


From which 
Pz 


K = 9.66 
Pa+Py ase) 


Substitution of equation (9.66) into (9.62) provides 


Ls Pa 
X=Asx la Ae 7 a B,) (9.67) 
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Es Measurement x+Pa + z 
———> System A S » 
+ 
X Measurement x+Pg Pa-Pa 
————» System B d » K 
Fig. 9.5 Integration of two measurement systems to obtain optimal estimate. 
or 
x= Ay — K(A,-— Bx) (9.68) 
Kis the Kalman gain and the total error variance expected is 
P=Pi1-K(Pa4— Py) (9.69) 
so that 
Xx=x+P4-K(Pa4 — Pg) (9.70) 


Equation (9.70) is illustrated in Figure 9.5. 


9.4.3 The Kalman filter multivariable state estimation problem 


Consider a plant that is subject to a Gaussian sequence of disturbances w(kT') with 
disturbance transition matrix C¿(T). Measurements z(k + 1)T' contain a Gaussian 
noise sequence v(k + 1)7' as shown in Figure 9.6. 

The general form of the Kalman filter usually contains a discrete model of the 
system together with a set of recursive equations that continuously update the 
Kalman gain matrix K and the system covariance matrix P. 

The state estimate X(k + 1/k + 1) is obtained by calculating the predicted state 
X(k + 1/k) from 

X(k + 1/97 = ADX(Kk/(OT + B(D)ju(kT>) (9.71) 


and then determining the estimated state at time (k + 1)7' using 
Xk +1/k+ DT =X(k + 1/97 + K(k + Diz(k + DT — C(D)X(k+1/k)T]j (9.72) 


The term (k/k) means data at time k based on information available at time k. The 
term (k + 1/k) means data used at time k + 1 based on information available at time 
k. Similarly (k + 1/k + 1) means data at time k + 1 based on information available at 
time k+ 1. 

The vector of measurements is given by 


Z(k + 1)T =C(T)Ix(k + DT + v(k + 1)T (9.73) 
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Disturbance noise 
W(kT) 


Measurement noise 
v(k+1)T 


Forward 
Step 


A 
= 
+ 
BA 
— 

P] 
= 
+ 
AA 
Y 
+ 

Al 
= 
+ 
Z 
Y 


Fig. 9.6 Plant with disturbance and measurement noise. 


where 


z(k + 1)T is the measurement vector 
C(T) is the measurement matrix 


v(k + 1)T is a Gaussian noise sequence 


The Kalman gain matrix K is obtained from a set of recursive equations that 
commence from some initial covariance matrix P(k/k) 


P(k + 1/k) = A(T)P(K/)JA UT) + CA(T)QCUT) (9.74) 
K(k +1) = P(k + 19IC UT ACT) +1/)C UT) +Ry > (9.75) 
P(k + 1/k+ 1) =(1-— K(k + )C(T)P(k + 1/k) (9.76) 


The recursive process continues by substituting the covariance matrix P(k + 1/k + 1) 
computed in equation (9.76) back into (9.74) as P(k/k) until K(k + 1) settles to a 
steady value, see Appendix 1, script files kalfilc.m for the continuous solution and 
kalfild.m for the above discrete solution. In equations (9.74) (9.76) 


Ca(T) is the disturbance transition matrix 
Q is the disturbance noise covariance matrix 
R is the measurement noise covariance matrix 


Equations (9.71)-(9.76) are illustrated in Figure 9.7 which shows the block diagram 
of the Kalman filter. 

The recursive equations (9.74)-(9.76) that calculate the Kalman gain matrix and 
covariance matrix for a Kalman filter are similar to equations (9.29) and (9.30) that 
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X(k/k)T zZ(k+1)T 
X(k+1/k+1)T 
Backward y + a 
Step NS K(k+1) 
y Y y(k+1/k)T 
X(k/k)T 
X(k+1/k)T 
y 
+ 
A(T) eS C(T) 
+ 
u(kT) 
=> B(7) 


Fig. 9.7 The Kalman filter. 


calculate the feedback matrix and Riccati matrix for a linear quadratic regulator. The 
difference is that the Kalman filter is computed in forward-time, the LQR being 
computed in reverse-time. 


9.5 Linear Quadratic Gaussian control system design 


A control system that contains a LQ Regulator/Tracking controller together with a 
Kalman filter state estimator as shown in Figure 9.8 is called a Linear Quadratic 
Gaussian (LQG) control system. 


r(kT) 
===>  LQ Optimal Uopi(KT) z(kT) 
Controller Plant == == 
X(kT) 


Kalman Filter 
State Estimator 


A 


Fig. 9.8 Linear Quadratic Gaussian (LOG) control system. 
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Case study 


Example 9.3 (See also Appendix 1, examp93.m) 

China clay is used in the paper, ceramics and fertilizer industries, and is washed from 
quarry faces, by high pressure hoses. A pressing operation reduces the moisture 
content in the clay to about 30%, and then the clay is extruded into small cylindrical 
shaped noodles. The clay noodles are then passed through the band drying oven 
shown in Figure 9.9 at rates varying between 2 and 15 tonnes/hour. Upon exit, the 
moisture content of the clay should be controlled to a desired level of between 4 and 
12%, with a deviation of no more than +1%. The process air is heated by mixing the 
exhaust gas from a gas burner with a large quantity of dilution air to meet the 
specified air flow-rate into the dryer. 

An existing control arrangement uses a PID controller to control the temperature 
of the process air (measured by thermocouples) and the dry clay moisture content 
measured by samples taken by the works laboratory. If this is out of specification, 
then the process air temperature is raised or lowered. The dry clay moisture content 
can be measured by an infrared absorption analyser, but on its own, this is consid- 
ered to be too noisy and unreliable. 

The important process parameters are 


(a) Burner exhaust temperature tp(t) ("C) 
(b) Dryer outlet temperature ta(1) (*C) 
(c) Dryer outlet clay moisture content mr(1) (%) 


The important control parameters are 


(1) Burner gas supply valve angle v,(*) (rad) 
(11) Dryer clay feed-rate f¡(1) (tonnes/hour) 


Process Air 
Wet 
Clay In —> Top Band > 
( 
Middle Band «*— 
[ ] 
Lower Band il —> Dry Clay 


Out 


] 


Exhaust Air 


Fig. 9.9 Band drying oven. 
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A proposed control scheme by Drew and Burns (1992) uses an LOG design, whereby 
the three process parameters are controlled in an optimal manner, their values 


(particularly the moisture control) being estimated. 


System model: The dynamic characteristics of the dryer were measured experimen- 
tally. This yielded the following transfer functions 
Burner model 
Tb 420 
G¡(s) = y, = EA (9.77) 
Dryer model 
Ta 0.119 
Gaxís) = = 9.78 
1) =7,= 142005 di 
Moisture models 
Mi 0.167 
= = . 9 
G31(5) T ()=3 4205 (9.79) 
_Mr,. 0.582 
60= 0=77 440, (9.80) 
Equations (9.79) and (9.80) can be combined to give 
_ =0.167T4(s) + 0.582F;(s) 
Mr(s) = 1 + 4405 (9.81) 
The block diagram of the system is shown in Figure 9.10. 
Continuous state-space model: From equations (9.77)X(9.81) 
47tp + ty(1) = 420va(1) 
2004 + ta(t) = 0.119ta(1) (9.82) 
44011 + mt(t) = —0.167t4(t) + 0.5824i(1) 
Hs) — » | 
Clay Feed-rate : ds : 
(Disturbance : 
RO Burner Dryer Moisture ee 
VS RO rs 140 o ¡MAs) 
Valve Angle | Gi(s) Gx(s) » K »  Gx(s) 
| Dryer Temperature TAS) 
Burner Temperature To(5) 


Fig. 9.10 Model of band dryer system. 
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Define the state variables 
X1=lb, X2=Ílg, X3=Mf 
and the control variables 
U] = Va 
and the disturbance variables 
w=0, w=0, w=Af 
then equations (9.82) can now be written as 


X1 = —0.02128x; + 8.93617u; T C411W1 
X2 = 0.00060x1 = 0.00500x, + Caq22W> (9.83) 
x3 = —0.00038x> — 0.00227x3 + 0.00132w3 


where C4¡¡ and c¿2, are unknown burner and dryer disturbance coefficients, and are 
given an arbitrary value of 0.1. The state equations are written in the form 


Xx = Ax + Bu+ Cqw 


X1 0.0213 0 0 X1 8.9362 
Xx, | =| 0.0006 0.005 0 xa | + 0 u 
X3 0 —0.00038  —0.0023 | | x3 0 
01 0 0 w] 
+|0 01 0 w> 


0 0  0.00132 | | w 


to 10.0 X] 
ta|=|0 1 0 X2 (9.84) 
mg 0.0 1 X3 


Discrete system model: The discrete system model (without disturbances) is given by 


X(k + 1)T = A(D)X(KkT) + B(D)u(kT) (9.85) 


and the output equation is 


For a sampling time of 2 seconds, from equations (8.78) and (8.80) 


0.9583 0 0 17.4974 

A(T)= | 0.0012 0.9900 0 ; B(T)= | 0.0105 (9.86) 
0 —0.0008 0.9955 0 

LQR Design: Using the quadratic performance index 


Ls ¡l ("Qx + u'Rujd/ 
0 
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where Q and R are diagonal matrices of the form 


qu 0.0 de 1 
Q=|0 q2 0|; R= | e S | (9.87) 
0 0. q3 za 


From equations (9.20) and (9.21), the optimal control law is 
Uop: = —Kx 
where 
K=R BP (9.88) 


The design procedure employed was to maintain R as unity scalar, and systematically 
vary the diagonal elements of Q to achieve the performance specification. This was to 
maintain a dry clay moisture content of 6%, +1%, as the clay feed-rate varied from 6 
to 10 tonnes/hour. Also the drying oven temperature fa should not vary more than 
+3*C from the set point of 50*C. At each design setting, the clay feed-rate was 
varied according to 


wa(4) = 8 + 2sin(0.00154£) (9.89) 


Some results are presented in Table 9.1. 
It was found that q; had little effect, and was set to zero. From Table 9.1, the 
settings that meet the performance specification are 


0.0.0 
Q=|0 05 0O| r=1 (9.90) 
0 0 20 


From equation (9.25), the Riccati matrix is 


0 0.1. —0.2 
P=| 01 108  -—30 (9.91) 
-0.2 -—30 3670.4 


which gives, from equation (9.88), the feedback gain matrix 
K=[0.0072 0.6442 —1.8265] (9.92) 


The same results are also obtained from the discrete equations (9.29) and (9.30). 


Table 9.1 Variations in dryer temperature and moisture content 


qa 43 Variation in temperature t4 (C) Variation in moisture content (%) 


Max Min Max Min 
3 1 0.17 0 2.09 -2.11 
1 3 0.99 0 1.74 -2.13 
0.5 3 1.524 0 1.5 -2.15 
0.5 6 2.05 2.05 1.27 =1.27 
0.5 10 2.42 2.42 1.1 1.1 
05 20 2.86 2.86 0.89 —0.89 
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The closed-loop eigenvalues are 


s = —0.0449 + 0.0422 


s = 0.0033 bi 
Implementation: The optimal control law was implemented by using 
u = Ke 
where 
e=(r—-x) (9.94) 


This is shown in Figure 9.11. 

A discrete simulation was undertaken using equations (9.85) and (9.86) together 
with a disturbance transition matrix Ca(T), which was calculated using C¿ in equa- 
tion (9.84) and equation (8.80) for B(T), with a sampling time of 2 seconds. 


0.1958 0 0 
Ca(T) = | 0.0001 0.199 0 (9.95) 
0 —0.0001 0.0026 
The desired state vector was 
450 
r= | 50 (9.96) 
—6 


Note that the moisture content r3 is negative because of the moisture model in 
equation (9.79). The initial conditions were 


200 
x(0)= | 30 (9.97) 
30 
w 
Optimal Controller 
ri e u . x y 
A K EY YX=Ax+Bu+Cow Ho» Cc => 
= Dryer 


Fig. 9.11 Optimal control of band dryer. 
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and the disturbance vector 
w=|0 (9.98) 


where w3, the clay feed-rate was set at a value between 6 and 10 tonnes/hour. Figure 
9.12 shows the time response of u,(1), the gas-valve angle in radians. The valve angle 
was not allowed to have a negative value, so remained closed for the first 80 seconds 
of the simulation, when the dryer was cooling. The steady-state angle was 0.95 
radians, or 54”, 

Figure 9.13 indicates the burner temperature time response fp(t). The temperature 
falls from its initial value, since the gas valve is closed, and then climbs with a 
response indicated by the eigenvalues in equation (9.93) to a steady-state value of 
400*C, or a steady-state error of 50*C. 

Figure 9.14 shows the combined response of the dryer temperature ta(t) and the 
moisture content mr(t), the latter being shown as a positive number. The dryer 
temperature climbs to 48*C (steady-state error of 2*C) and the moisture falls to 
6%, with no steady-state error. In this simulation the clay feed-rate w3(f) was 
constant at 8 tonnes/hour. 

As the band dryer is a type zero system, and there are no integrators in the 
controller, steady-state errors must be expected. However, the selection of the 
elements in the Q matrix, equation (9.90), focuses the control effort on control- 
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Fig. 9.12 Time response of gas-valve angle ur (t). 
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Burner Temperature (*C) 


0 100 200 300 400 500 600 700 800 900 1000 


Fig. 9.13 Time response of burner temperature t,(t). 


ling the moisture content, at the expense of, in particular, the burner temperature 
tp(t). 

Figure 9.15 shows the final 500 seconds of the moisture content simulation as the 
clay feed-rate is varied between 6 and 10 tonnes/hour. After 1000 seconds, as the clay 
leaves the dryer, the moisture content is between 5.2% and 6.8%, which is within the 
specification of +1% of the set point of 6%. 


Kalman filter design: 1f the three stages of the covariance matrix P are written as 
P(k/k) =P¡; P(k+1/k) =P, and P(k+1/k +1) =P3, then recursive equations 
(9.74), (9.75) and (9.76) become 


P, = AP¡A* + C¿QC] 
K = PC (CP,C" +Ry 7? (9.99) 
Pz = (I— KCJP, 


Equation set (9.99) is simpler to visualize, but remember the system matrices are the 
transition matrices A(T'), B(7) and Ca(T). Before recursion can start, values for R, 
the measurement noise covariance matrix, and Q, the disturbance noise covariance 
matrix must be selected. 


Measurement noise covariance matrix R: The main problem with the instrumentation 
system was the randomness of the infrared absorption moisture content analyser. 
A number of measurements were taken from the analyser and compared with samples 
taken simultaneously by work laboratory staff. The errors could be approximated to 
a normal distribution with a standard deviation of 2.73%, or a variance of 7.46. 
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Fig. 9.14 Combined response of dryer temperature t¿(t) and moisture content mx(t). 
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Fig. 9.15 Effect of varying clay feed-rate. 
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The thermocouples measuring the burner and dryer temperatures were relatively 
noise-free, with standard deviations in the order of 0.1 C. The variance was therefore 
set at 0.01, giving 


0.01 0 0 
R=| 0 001 0 (9.100) 
0 0 7.46 


Disturbance noise covariance matrix Q: This was set as a diagonal matrix, where q;1 
and q2 represent changes in the burner and dryer temperatures as a result of 
changing heat transfer through the walls of the dryer, due to wind and variations 
in external temperature. 

On the other hand, q33 is a measure of clay feed-rate variations, and a standard 
deviation of 0.3 tonnes/hour seemed appropriate. In the absence of any other infor- 
mation, standard deviations of the burner and dryer temperatures was also thought to 
be in the order of 0.3?C. Thus, when these values are squared, the Q matrix becomes 


01. 0 0 
Q=|0 01 0 (9.101) 
0 0 01 


Before equations (9.99) can be run, and initial value of P(k/k) is required. Ideally, 
they should not be close to the final value, so that convergence can be seen to have 
taken place. In this instance, P(k/k) was set to an identity matrix. Figure 9.16 shows 
the diagonal elements of the Kalman gain matrix during the first 20 steps of the 
recursive equation (9.99). 
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Fig. 9.16 Convergence of diagonal elements of Kalman gain matrix. 
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Fig. 9.17 Measured and filtered clay 
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The final values of the Kalman Gain matrix K and covariance matrix P were 


0.4408 0.0003 0 0.0044 0 0 
K= |0.0003 0.4579 0 p P= 0 0.0046 0 (9.102) 
0 —0.0006 0.0325 0 0 0.2426 


The full LOG system, comprising of the LQ optimal controller and Kalman filter was 
then constructed. Figure 9.17 shows a set of moisture content measurements z3(kT') 
together with the estimated moisture content X3(KT'). 


9.6 Robust control 
9.6.1 Introduction 


The robust control problem is to find a control law which maintains system response 
and error signals within prescribed tolerances despite the effects of uncertainty on the 
system. Forms of uncertainty include 


e Disturbance effects on the plant 

e Measurement noise 

e Modelling errors due to nonlinearities 

e Modelling errors due to time-varying parameters 

In previous chapters, linear models have been used to describe plant dynamics. 
However, in section 2.7.1 it was demonstrated that nonlinear functions could be 
linearized for small perturbations about an operating point. It is therefore possible to 
describe a nonlinear system by a series of linear models each constructed about 
a known operating point. Ifthe operating point can be linked to a measurement, then 
a simple robust system may be constructed using an LQG approach. The feedback 
and Kalman gain matrices are calculated in advance for each operating point and 
some form of interpolation used to provide a “Gain Scheduling Controller.” 

The disturbance and measurement noise is taken into account by the Kalman 
filter. In the following example, undertaken by the author (1984), a non-linear 
simulation of a ship of length 161m and displacement 17000 tonnes was given 
a series of step changes in demanded rudder-angle at forward speeds of 2.572 m/s 
(5knots), 5.145 m/s (10 knots) and 7.717 m/s (15 knots). At each forward speed a linear 
model was constructed and the Q and R matrices in an LOG implementation selected 
to return the closed-loop eigenvalues back to some desired value (Ackermann's 
formula could not be used since y(*) and u(t) were vector, not scalar quantities). 

A subset of the state error variables is 


er(t) = cross-track position error 
ex(t) = cross-track velocity error 
ez(t) = heading error 

es(t) = heading-rate error 
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The feedback control is of the form 
Uop: = Ke 
where the values of K for the three forward speeds are 


K> 57 =1[0.0121 1.035 7.596 160.26] 
Ks 14s = [0.0029 0.3292 1.81 25.963] (9.103) 
K3717 =[0.0013 0.1532 0.8419 8.047] 


If the forward velocity of the ship is the state variable u,, a best estimate of which is 
given by the Kalman filter, the gain scheduling controller can be expressed as 


k¡ = 0.0842 
k, = 6.04 1% 
kz = 50.040 peo 


ka = 2090.04, +72 


Equation set (9.104) approximates to an inverse square law, and increases the 
controller gains at low speeds, where the control surfaces are at their most insensitive. 

In general, however, robust control system design uses an idealized, or nominal 
model of the plant G.(s). Uncertainty in the nominal model is taken into account by 
considering a family of models that include all possible variations. The control 
system is said to have robust stability 1f a controller can be found that will stabilize 
all plants within the family. However, on its own, robust stability is not enough, since 
there may be certain plants within the family that are on the verge of instability. 
A controller is said to have robust performance if all the plants within the family meet 
a given performance specification. 


9.6.2 Classical feedback control 


Figure 9.18 shows a classical feedback control system D(s) is a disturbance input, 
N(s) is measurement noise, and therefore 


Y (s) = G(s)U(s) + D(s) 
Bís) = Y(s) + N(s) (9.105) 
U(s) = C(S(R(s) — B(s)) 


Controller/Compensator Plant D(s) 
Rís) + U(s l 
¡E ES as LP A as + po 
- + 


+ 
6%) de Ns) 
B(s) 


Fig. 9.18 Classical feedback control system. 
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Eliminating U(s) and B(s) from equations (9.105) gives 


— G(s)C(s)R(s) D(s) G(SC(SN(s) 
-—1+G(SC(s) 14+G(sC(s) 1+G(s)C(s) 


Define a sensitivity function S(s) that relates Y(s) and D(s) when R(s) = N(s) =0 
1 


Y(s) (9.106) 


Y 
(5) = Ss) = —————— 9.107 
DO == 5000 ano 
and define a complementary sensitivity function 
G(s)C(s) 
T(s),=1- = ——=——— 9.108 
(+) $0=cecO e 
Thus, when N(s) = 0, equation (9.106) may be written 
Y(s) = T(s)R(s) + S(s)D(s) (9.109) 


If T(s) = l and S(s) = 0 there is perfect set-point tracking and disturbance rejection. 
This requires that G(s)C(s) is strictly proper (has more poles than zeros), so that 


lim G(s)C(s) =0 (9.110) 


However, if N(s) % 0, then equation (9.106) becomes 
Y (s) = T(SR(S) + S(9D(sS) — T(SN(s) (9.111) 


Hence, if T(s) = 1, there will be both perfect set-point tracking and noise acceptance. 
Considering the problem in the frequency domain however, it may be possible that at 
low frequencies T(jw)— 1 (good set-point tracking) and at high frequencies 
T(jw) — 0 (good noise rejection). 


9.6.3 Internal Model Control (IMC) 


Consider the system shown in Figure 9.19 G(s) is the plant, Gm(s) is the nominal 
model, R(s) is the desired value, U(s) is the control, D(s) is a disturbance input, Y(s) is 
the output and N(s) is the measurement noise. C(s) is called the IMC controller and is 
to be designed so that y(1) is kept as close as possible to r(t) at all times. 

From Figure 9.19, the feedback signal B(s) is 


B(s) + G(s)U(s) + D(s) + N(s) — Gmís)U(s) 
or 
Bs) = (G(s) — Gnís)U(s) + D(s) + N(s) (9.112) 


If, in equation (9.112) the model is exact, 1.e. Gp(s) = G(s) and the disturbance D(s) 
and noise N(s) are both zero, then B(s) is also zero and the control system is 
effectively open-loop. This is the condition when there is no uncertainty. However, 
1£ Gmís) 4 G(s), and D(s) and N(s) are not zero, then B(s) expresses the uncertainty of 
the process. 
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Fig. 9.19 Block diagram of an IMC system. 


9.6.4 IMC performance 

From Figure 9.19 
Y (s) = G(s)U(s) + DÍs) 
Bís) = Y(s) + N(s) — Gm(s)U(5) (9.113) 
U(s) = C(sAR(5) — B(s)) 

Eliminating U(s) and B(s) from equations (9.113) gives 


G(s)C(s)R(s) (1 — C(s)Gmts)D(s) G(s)C(sIN(s) 
1 + C(sMG(s) — Gmls)) 1 +C(sMG(5) — Gmts) 1 + C(sKG(s) — Gs) 
(9.114) 


Y(s) = 


The sensitivity function S(s) that relates Y(s) and D(s) when R(s) = N(s) = 0 is 


ego 1 — C(SGmí(s) 
DO == Ec - Gn) ALS) 
and the complementary sensitivity function 
E C(s)G(s) 
CO 1-02 TF COCO — Gt) e 
Thus, when N(s) = 0, equation (9.114) may be written 
Y(s) = T(NR(S) + S(S9D(S) (9.117) 


If T(s) = 1 there is perfect set-point tracking. This will occur if Gm(s) = G(s) and 
C(s) = 1/G(s). If S(s) = 0 there is perfect disturbance rejection. Again, this will occur 
1£ Gps) = Gís) and C(s) = 1/Gn(s). 


Two degree-of-freedom IMC system 
If good set-point tracking and good disturbance rejection is required when the 
dynamic characteristics of R(s) and D(s) are substantially different, then 1t may be 
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Fig. 9.20 Two degree-of-freedom IMC system. 


necessary to introduce a second controller, which provides a second degree-of-free- 
dom of control action. A two degree-of-freedom IMC system is shown in Figure 9.20. 
With a two degree-of-freedom IMC system, equation (9.114) becomes 


Y(s) = G(s)CHs)R(s) (1 — Cals)Gm(s)D(s) 
14 Cal(sKG(s) — Gmís)) — 1 + CalsXG(s) — Gmls)) iS 
G(SCA(IN(S) 


1 + Ca(sK(G(s) — Gmís)) 


In equation (9.118) C;(s) is designed for set-point tracking and Ca(s) for disturbance 
rejection. 


9.6.5 Structured and unstructured model uncertainty 


Unstructured model uncertainty relates to unmodelled effects such as plant distur- 
bances and are related to the nominal plant G.(s) as either additive uncertainty £,(s) 


G(s) = Gmís) + la(s) (9.119) 
or multiplicative uncertainty £m(s) 
G(s) = (1 + £m(s)Gmís) (9.120) 
Equating (9.119) and (9.120) gives 
Lals) = £m(s)Emís) (9.121) 
Block diagram representations of additive and multiplicative model uncertainly are 
shown in Figure 9.21. 


Structured uncertainty relates to parametric variations in the plant dynamics, i.e. 
uncertain variations in coefficients in plant differential equations. 
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Fig. 9.21 Adoditive and multiplicative model uncertainty. 


9.6.6 Normalized system inputs 


All inputs to the control loop (changes in set-point or disturbances) are generically 
represented by V(s). The input V(s) is found by passing a mathematically bounded 
normalized input V!(s) through a transfer function block W(s), called the input 
weight, as shown in Figure 9.22. 


Specific inputs 


Impulse VU(s)=1 W(s)=1 


(9.122) 
Step VUs)=1 W(s=1/s 
Thus for specific inputs 
V(s) = W(9SV Us) = W(s) (9.123) 
Sets of bounded inputs may be represented by 
rol= IN Word <1 (9.124) 


The left-hand side of equation (9.124) is called “the 2-norm of the input signal v!(1) 
squared”. Norms are mathematical measures that enable objects belonging to the 


V (s) 


2» Ws) di 


Fig. 9.22 Transformation of a normalized bounded input V* (s) into an actual input V(s). 
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same set to be compared. Using Parseval's theorem, equation (9.124) may be trans- 
formed into the frequency domain 


ran 1 f2|VGuo) 
AGE Ad Wo) 


2 
dw<1 (9.125) 


For a realizable controller to exist, all external signals that enter the control loop 
must be bounded. 


9.7 H>- and H..-optimal control 


9.7.1 Linear quadratic H>-optimal control 


The scalar version of equation (9.48), when u(z) is not constrained, and O is unity, 1s 
called the Integral Squared Error (ISE), 1.e. 


ISE = / f e(0di (9.126) 


0 


The A>-optimal control problem is to find a contoller c(t+) such that the 2-norm of the 
ISE (written lecol15) 1s minimized for just one specific input v(+). 

If, in equation set (9.105) B(s) and Y(s) are eliminated and U(s) is written as 
C(s)E(s), then 


E(s) = 1+60C0 L[R(s) — D(s) — N(s)) 
= S(SR(s) — D(s) — N(s)) (9.127) 
Also, from equation (9.123), for a specific input 


Vís) = W(s) (9.128) 


Using Parseval's theorem, from equation (9.126) the A>-optimal control problem can 
be expressed in the frequency domain as 


min||e(s)[3= minz_ / |E(ju)] di (9.129) 
Substituting equations (9.127) and (9.128) into (9.129) gives 
EA e 
min||e(1)l5= minz, / ¡SG)W(jw!?dw (9.130) 
C C TJ-xo 


Thus the A>-optimal controller minimizes the average magnitude of the sensitivity 
function weighted by W(jw), where W(jw) depends upon the specific input V(jw). In 
mathematical terms, the controller minimizes the 2-norm of the sensitivity function 
welghted by W(jw). 
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9.7.2 H..-optimal control 


With HA..-optimal control the inputs V(jw) are assumed to belong to a set of norm- 
bounded functions with weight W(jw) as given by equation (9.125). Each input 
V (ju) in the set will result in a corresponding error E(juw). The H..-optimal controller 
is designed to minimise the worst error that can arise from any input in the set, and 
can be expressed as 


min||e()||,¿= min sup|SGuw)W(o)| (9.131) 


In equation (9.131), sup is short for supremum, which means the final result is the 
least upper bound. Thus the A..-optimal controller minimizes the maximum magni- 
tude of the weighted sensitivity function over frequency range w, or in mathematical 
terms, minimizes the co-norm of the sensitivity function weighted by W(jw). 


9.8  Robust stability and robust performance 


9.8.1 Robust stability 


Robust stability can be investigated in the frequency domain, using the Nyquist 
stability criterion, defined in section 6.4.2. 

Consider a Nyquist contour for the nominal open-loop system Gr(jw)C(juw) with 
the model uncertainty given by equation (9.119). Let La (w) be the bound of additive 
uncertainty and therefore be the radius of a disk superimposed upon the nominal 
Nyquist contour. This means that G(jw) lies within a family of plants 7(G(jw) € 7) 
described by the disk, defined mathematically as 


=(G: |G(jw) — Gmlj)| < Lale), (9.132) 
and therefore 
La(ju)] < Lati) (9.133) 
If the multiplicative uncertainty in equations (9.120) and (9.121) is defined as 
La(ju) 
La(Jw) = +5 9.134 
oc deis 
and the bound of multiplicative uncertainty 
Ñ La(w) 
Law) = >= Ar (9.135) 
[Gr (ju) C (ju)! 
From equation (9.135) the disk radius (bound of uncertainty) is 
La(w) = |[En(ju)C(j) ete) (9.136) 


From the Nyquist stability criterion, let N(k, G(jw»)) be the net number of clockwise 
encirclements of a point (k, 0) of the Nyquist contour. Assume that all plants in the 
family r, expressed in equation (9.132) have the same number (1) of right-hand plane 
(RHP) poles. 
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Re 
4 — 1Gimn(jw) Cljco) | 
11 + Gmr(ju) Cljio)| 
11 + Gli) Clio)! 
for some G(ju)er 
1Gn(ju) Oli) m(w) 
Fig. 9.23 Robust stability. 
There will be robust stability of a specific controller C(jw) if and only if 
NEl, G(juyC(jw) =—n for all G(ju) € 7 (9.137) 
It is also necessary for the nominal plant G.,,( jw) to be stable 
NEL, Gm(ju)C(w)) =—n (9.138) 


From Figure 9.23 robust stability occurs when the vector magnitude 
ll + Gn(ju)C(ju)| (see also Figure 6.25) exceeds the disk radius |Gn(ju)C(jayl mw) 


+ Gn(juyCGw)! > [Gn( ju) CG) (w) for all w 
or 


Gin( ju) C (ju) 


1 + Gm(ju)C(jw) a! (9.139) 


Equation (9.139) uses the magnitude of the complementary sensitivity function 7(jw) 
as defined in equation (9.108). Thus 


|TGO)|£ntw) < 1 for all w (9.140) 


Robust stability can therefore be stated as: “If all plants G(s) in the family 7 have the 
same number of RHP poles and that a particular controller C(s) stabilizes the 
nominal plant G,.(s), then the system is robustly stable with the controller C(s) 1f 
and only if the complementary sensitivity function 7(s) for the nominal plant Gm(s) 
satisfies the following bound 


[|[T Gwen) lloo = sup| T Gwen) < 1 (9.141) 
where the LHS of equation (9.141) is the infinity norm of T(jwWn(jw). This means 


that robust stability imposes a bound on the co norm of the complementary sensi- 
tivity function T(jw) weighted by £m(w). 
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9.8.2 Robust performance 


Robust stability provides a minimum requirement in an environment where there is 
plant model uncertainty. For a control system to have robust performance it should 
be capable of minimizing the error for the worst plant (1.e. the one giving the largest 
error) in the family G(jw) € r. 

For the H,,¿-control problem, from equation (9.131), the co-norm of the weighted 
sensitivity function can be written 


[SW ¿= sup SGuo)W(Gw)| (9.142) 


If, as part of the design process, a bound is placed upon the sensitivity function 
[SG)| < |WGA" (9.143) 
Should an HA.,, controller be found such that 
ISWI.< 1 (9.144) 
then the bound in equation (9.143) is met. Hence, for robust performance 


SW! =sup| Sia) W(jo)| < 1 for all G(ju) e 7 (9.145) 


From Figure 9.23 representing robust stability, the actual frequency response 
G(juw)C(jw) will always lie inside the region of uncertainty denoted by the disk, or 
[14 GGwC(w)] > 1 +Gn(juC(jw)] - [Gm(ju)C(jw)lem(w) for all G(jw) € 7 
(9.146) 


glving 
1 
1 + G(juyC(jw) 


[Si 
= 1 [Tn(jw)|Entwo) 


ISGu)| = | for all G(jwu) er (9.147) 


where Som(jw) is the sensitivity function for the nominal plant 


1 


Smí(jw) = - - 9.148 
02106) cid 

Using equation (9.147), equation (9.145) can be expressed as 
A (9.149) 


> | Ton (Ja) em(w) 
Or 


ITa(joJnto)! +1Sm(jw)W(Gw)| < 1 for all w (9.150) 
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R(s) + >| 4 + Y(s) 
Be (1+8)(1+25) + d 


Fig. 9.24 Control system. 


Robust performance then means that the closed-loop system will meet the perform- 
ance specification given in equation (9.145) if and only if the nominal system 1s 
closed-loop stable (equation (9.141)) and that the sensitivity function Sm(jw) and 
complementary sensitivity function Tm(jw) for the nominal system satisfy the rela- 
tionship given in equation (9.150). 


Example 9.4 

(a) For the control system shown in Figure 9.24 produce the Bode magnitude plots 
for the sensitivity function |S(jw»)| and the complementary sensitivity function 
[TGw)| when K = 10. Comment on their values. 

(b) For a step input, let W(s) = 1/s. Produce Bode magnitude plots for |S(jw)W(jw)| 
when K = 10, 50 and 100 and identify the optimal value using both H» and Ho, 
criteria. 


Use a frequency range of 0.01-100 rad/s for both (a) and (b). 


Solution 
(a) From equation (9.107) 


1 1 
S(s == —+ 
OO e 
252 + 35+1 
9.151 
22 + 35+(1+K) ma 
From equation (9.108) 
2 +39+1 
T(s) =1-—S(s)= 1 
(s) ed A o) 
ió (9.152) 


"22 +35 +(1+K) 


The Bode magnitude plots for |S(jw)| and |7T(jw)| are shown in Figure 9.25 for 
K = 10. From Figure 9.25 it can be seen that up to 1 rad/s, the system has a set- 
point tracking error of —0.8dB (|T(jw)H) and a disturbance rejection of 
-204B (|S(jw)). 
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(b) For a specific input of a unit step, let W(s) = 1/s. Hence the weighted sensitivity 
function is 


2 + 35+1 
s(2? + 35 + (1 +K)) 


S()W(s) = (9.153) 


The Bode magnitude plots for |S(ju)W(jw)| for K = 10, 50 and 100 are shown in 
Figure 9.26. 

From Figure 9.26 it can be seen that the H>-norm, or average value of the weighted 
sensitivity function (equation (9.130)) reduces as K increases and hence, using this 
criteria, K = 100 is the best value. Using the H.,¿-norm as defined in equation (9.131), 
the maximum magnitude of the weighted sensitivity function occurs at the lowest 
frequency. The least upper bound therefore is OdB, occurring at 0.01 rad/s when 
K = 100, so this again is the best value. 


Example 9.5 
A closed-loop control system has a nominal forward-path transfer function equal to 
that given in Example 6.4, i.e. 


K 


Gm (s)C(s) = (74 25+4) 


AN TAL 


IS(jw)! 


Gain 
(dB) 


10 107 10" 10 10 
Frequency (rad/s) 


Fig. 9.25 Bode magnitude plots for |S(juw»)| and |T(ju) 
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Let the bound of the multiplicative model uncertainty be 


0.5(1 +) 


a) = 10255) 


What is the maximum value that K can have for robust stability? 


Solution Ñ 
At frequencies below 1rad/s, fm(w) >0.5 and at frequencies above 4rad/s 
£i(w) — 2.0. From equation (9.141), for robust stability 


[TGwLn(w)| < 1 (9.154) 
now 
T(s) = Gm(s)C(s) 
1+Gmn(s)C(s) 
therefore 
E 
T(s) pe 53+252+45 
Vente 53 2774 
K 
T = 
(5) $ +23 4454 K 
20 
10 
0 
IS(jo) Mi) K=10 PABSO 

-10 E 

ósb K=50 
30 

K=100 
-40 
10” 107 10” 10' 107 


Frequency (rad/s) 


Fig. 9.26 Bode magnitude plot of weighted sensitivity function for Example 9.4. 


312 Advanced Control Engineering 


10 


50 2 an] 0 1 
Frequency (rad/s) 


Fig. 9.27 Bode plot of |T(jw)Lo(w)| for Example 9.5. 


thus 
- 0.5K(1l +5) 
TOMO FR 

The Bode magnitude plot for equation (9.155) is shown in Figure 9.27 when K = 2 
and 3.5. 

In Example 6.4, when there was no model uncertainty, K for marginal stability was 
8, and for a gain margin of 6dB, K was 4. In this example with model uncertainty, 
from equation (9.154) marginal stability occurs with K = 3.5, so this is the maximum 
value for robust stability. For robust performance, equation (9.150) applies. For a 
specific step input let W(s) = 1/s now 


(9.155) 


ES + 25? + 4s 
di 9.1 
Smís) UE ER ER (9.156) 
and 
s(s? + 25 +4) 
W ph] 
Smls) W (s) s(s3 +25? + 45 + K) 
hence 
24 25+4 
Sw) = se +2s+ (9.157) 


54254454 K 


The Bode magnitude plot of the weighted sensitivity function is shown in Figure 9.28 
for K = 2, 2.5 and 3.5. 
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Fig. 9.28 Bode magnitude plot of weighted sensitivity function for Example 9.5. 


For robust performance 
[Tm (Gu) + Em (w0)| +|Sm(jo)W(Gw<l1 for all w (9.158) 


From Table 9.2 it can be concluded that: 


(a) The control system has robust stability up to K = 3.5. 

(b) The A.,¿-norm is >1 for all values of K considered. Therefore equations (9.145) 
and (9.150) are not met and the system cannot be considered to have robust 
performance. 


From (b) above, it must be concluded that the controller C(s) must be something 
more sophisticated than a simple gain constant K. 


Table 9.2 Robust performance for Example 9.5 


w (rad/s) 0.01 1.5 

K Ze 2.9 3.5 2 2,5 3.5 

[Tan (Lin (w)| 0.5 (—6dB) 0.5 (not shown in 0.5 0.5 0.63 (not shown in 1.0 
Figure 9.27) Figure 9.27) 

ISmljw)WGw 2.0 (6dB) 1.58 112 096 105 1.26 


Sum 2:3 2.08 1.62 1.46 1.68 2.26 
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9.9 Multivariable robust control 


9.9.1 Plant equations 


The canonical robust control problem is shown in Figure 9.29. 

In Figure 9.29, u> are the inputs to the plant P,, from the controller and u; are the 
disturbance and noise inputs. Also, y, are the outputs to be controlled and y, are the 
outputs that are fed back to the controller. 

If P.,(s) and the plant uncertainty A(s) are combined to give P(s), then Figure 9.29 
can be simplified as shown in Figure 9.30, also referred to as the two-port state-space 
representation. 

The state and output equations are 


x= Ax+Bju; + Bou» 
y; = Cix+D;/u + D;2u> 
y, = Cax + Du; + Do2u»> (9.159) 


Equation (9.159) can be combined 


Xx A Bi; B, xXx 
y =|Ci Di Do2||u (9.160) 
Y C? D D||u 


Uncertainty 


A(s) lt, 
u, Y; 
Plant 
——> 
——> 
Us Controller Yo 
C(s) A) 


Fig. 9.29 The canonical robust control problem. 
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u, Y; 
——> — >» 
P(s) 
u) Y 
C(s) ——— 


Fig. 9.30 Two-port state-space augmented plant and controller. 


Hence the augmented plant matrix P(s) in Figure 9.30 is 


P(s) = E lc ad (9.161) 
C, : Da D> 


From the partitioned matrix in equation (9.161), the closed-loop transfer function 
matrix relating y, and u; is 


Ty,u = Pi1(s) + Pr(s) U — C(s) Pr(s) C(s) P>1 (5), (9.162) 
where 


u(s) = C(s)y2(s) (9.163) 


9.9.2 Singular value loop shaping 


The singular values of a complex n x m matrix A, denoted by o;¡(A) are the non- 
negative square-roots of the eigenvalues of ATA ordered such that 


01>02>-::>0p p=minín, m) (9.164) 


The maximum singular value d of A and the minimum singular value d of A are 
defined by 


r(A) = ¡All 
AA) = AT o? if AT! exists (9.165) 


As with a SISO system, a sensitivity function may be defined 


Sís) = (1+ G(59C(s) (9.166) 
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where G(s) is the non-augmented plant matrix. For good performance S(s) should 
be as small as possible. The complementary sensitivity function is 


T(s) = G(s) C(s) 1 + G(NC(s) (9.167) 
where 
S(s) + T(s) = I (9.168) 


The singular value of the sensitivity function 7(S(jw)) and of the complementary 
sensitivity function 7(T(jw)) can be displayed as Bode plots and play an important 
role in robust multivariable control system design. 

The singular values of S determine the disturbance attenuation, and thus a per- 
formance specification may be written 


AS(jw)) < |W¿*(jw)| (9.169) 


where [Wo a ju)| is a desired disturbance attenuation factor. If Am(s) is a diagonal 
matrix of multiplicative plant uncertainty as illustrated in Figure 9.29, it can be 
shown that the size of the smallest stable An(s) for which the system becomes 
unstable is 


HAm(ju)) = 1/4(T(jw)) (9.170) 
or alternatively 
a(Tjw)) < [W;'Gu)| (9.171) 


where |W.+(jw)| is the size of the largest anticipated multiplicative plant uncertainty. 


9.9.3 Multivariable H, and H.. robust control 


The A>-optimal control problem is to find a stabilizing controller C(s) in equation 
(9.163) for an augmented plant P(s) in equation (9.161), such that the closed-loop 
transfer function matrix Ty,u, in equation (9.162) is minimized. 

Thus 


y O TT . ye 
min [[Ty,u¡ ||, = mins — trace(Ty,u (ju) Ty, u (jw)dw 9.172 
0 [yu [> sind | (Ty u Go) Ty u (ju), ) ( ) 


where T is the complex conjugate transpose, and trace is the sum of the diagonal 
elements. The A, robust control problem is to find a stabilizing controller C(s) for 
an augmented plant P(s), such that the closed-loop transfer function matrix Ty,u; 
satisfies the infinity-norm inequality 


[Ty u [|,,= sup Omax(T yu (ju) < 1 (9.173) 


Equation (9.173) is also called the small gain” infinity-norm control problem. 


Optimal and robust control system design 317 


9.9.4 The weighted mixed-sensitivity approach 


Multivariable loop shaping in robust control system design may be achieved using 
a welghted mixed sensitivity approach. As with the SISO systems described in section 
9.8.2, the sensitivity function S(s) given in equation (9.166) and the complementary 
sensitivity function T(s) given in equation (9.167) may be combined with weights 
Ws(s) and Wr.(s) to give 


— TWss) S(s) 
us Be 20 Lil 


where the infinity norm of Ty,u, is <1l as given in equation (9.173). Equation (9.174) 
defines a mixed-sensitivity cost function since both S(s) and T(s) are penalized. Note 
that if W,(s) weights the error and W.«(s) the output, the two-port augmented plant 
given in Figure 9.30 may be represented by Figure 9.31. 


Example 9.6 (See also Appendix 1, examp96.m) 
A plant has a transfer function 


200 
G(s) = 9.175 
()= 324 1025 $ 200 (a) 
given the sensitivity and complementary weighting functions 
100 +s 
mo (100) 
a (9.176) 
+ s 
pS ( 0) 


Fig. 9.31 Weighted mixed-sensitivity approach. 
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determine the singular value Bode magnitude plots for 

(a) the plant G(juw) 

(b) the weighting functions W¿*(jw) and W;'(jw) 

(c) the cost function Ty,u¡(jw) at 1ts optimal value of y (given in W,(s)) 

(d) the A..-optimal controller C(jw) 

Find also the state-space and transfer function expressions for the controller. 


Solution 
The state-space representation of the plant G(s) is 


3 102-200 31 

Ag Bel | 1 0 o. 30 

E De) 0 1 o. 20 Read 
0. 0. 20 20 


The singular value frequency response G(jw) is shown in Figure 9.32. 

The frequency response of the reciprocal of the weighting functions W¿*(jw) 
(y = 1) and W¿'(jw) are given in Figure 9.33. 

The optimal value of Ty,u, is achieved when (y = 0.13) and its singular value 
frequency response is shown in Figure 9.34. 

The controller single value frequency response C(jw) is illustrated in Figure 9.35. 


20 


IG(ju)! 30 


107 10" 10' 107 
Frequency (rad/s) 


Fig. 9.32 Plant singular value Bode magnitude plot. 
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Frequency (rad/s) 


Fig. 9.33 Weighting functions Bode magnitude plots. 


4 
[Ty ¿uy (ju)! 
(dB) 6 


e 10? 107 100 10 10? 10? 


Frequency (rad/s) 


Fig. 9.34 Singular value Bode magnitude plot of |Ty: u1 ( juw»)| when y = 0.13. 
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20 
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Frequency (rad/s) 
Fig. 9.35 Controller single value Bode magnitude plot |C( jw)|. 
The state-space representation of the controller C(s) is 
0.01. —0.002 0.004 0.015 0.137 7.976 
—0.009 —7.763 21.653 37.164 621.89 0.091 
A. B.]_|—0.046 -—2.032 —3.148 2.234 —81.88 0.582 
[és 1:)- 
0.435 0.107 8.807  —102.25 37.78 8.8 
0.676 0.197 13.558  —3.728 162.51 —13.66 
—0.086 0.169 0.121 —0.654 11.17 0 
(9.178) 


and the controller transfer function is 


15954 + 16.4 x 1075 + 63.9 x 10524 1.6 x 105 + 3.18 x 106 


C(s) = 


5 + 27554 + 20.4 x 10353 + 324.8 x 10352 4 3.78 x 1065 + 37.8 x 103 


(9.179) 


The results in this example were obtained using the MATLAB Robust Control 


Toolbox. 
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9.10 Further problems 


Example 9.7 


In a multivariable optimal regulator system, the plant state equations are 


lá La a Le Ñ La] 


If the performance index to be minimized is 


J= / É (x1Qx + 12)d1 


(9.180) 


(9.181) 


(a) Determine, by hand, the elements of the Riccati matrix P in the reduced Riccati 


equation 


PA+A'P+0Q-—PBR'B'P=0 


given that 


(b) Find the optimal feedback matrix K so that 
K=R"B'P 
and hence calculate the closed-loop eigenvalues. 


Solutions 
1.703 0.183 
a lus rel 


(b) K=[0.732 0.772] 
s =-—-2,544 + 30.675 


Example 9.8 
A plant and measurement system are described by 


Xx = Ax + Bu+ Cqw 
y = Cx 
Z=Y+V 


(9.182) 


(9.183) 


(9.184) 


(9.185) 
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where w(1) is a Gaussian sequence of disturbances and v(1) is a Gaussian sequence of 
measurement noise. z(t) is the measured value of y(t) that is contaminated with 
measurement noise v(1). The plant parameters are 


0 1 0 0 
A = 0 0 1 B=|0 
50 -—102 -4.5 100 
(9.186) 
05 0 0 10.0 
Ca=|0 05 0 C=|0 10 
0 o 10 0.0 1 
The measurement noise and disturbance covariance matrices are 
01 0 0 01 0 0 
R=|0 01 0 Q=|0 01 0 (9.187) 
0 0 6 0) 0 2 


(a) For a sampling time of 0.1 seconds, using equations (8.78) and (8.80) calculate 
the discrete-time state transition, control and disturbance matrices A(T), B(T') 
and Ca(T). 

(b) Starting with an initial covariance matrix P(k/k) equal to the identity matrix, 
perform 20 recursions of equations (9.74), (9.75) and (9.76) to compute the 
Kalman gain matrix K(k + 1) and covariance matrix P(k + 1/k +1). 


Solutions 
0.993 0.085 0.004 0.014 
(a) A(T)= | -0.199 0.587 0.067 B(T) = | 0.398 
—3.370 —7.074 0.284 6.740 
0.050 0.002 0.001 
Ca(T)= | -0.004 0.043 0.040 


0.100 —0.207 0.674 


0.040  —0.006 —0.002 

(b)  K(k+1) =|-0.006 0.137 0.003 
0.133 0.155 0.218 

0.004  —0.001 —0.013 

P(«+1/k+1)= | —0.001 0.014 0.016 
0.013 0.016 1.310 


Example 9.9 

The plant described in Example 9.8 by equations (9.185) and (9.186) is to be 
controlled by a Linear Quadratic Gaussian (LOG) control scheme that consists of 
a LQ Regulator combined with the Kalman filter designed in Example 9.8. The 
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quadratic performance index to be minimized for the LQ regulator is of the form 
given in equation (9.181) where 


10 0.0 
Q=|0 5 0| (R=1) (9.188) 
Mo dl 


Using the recursive equations (9.29) and (9.30), solve, in reverse time, the Riccati 
equation commencing with P(V) =0. 

If the sampling time is 0.1 seconds, the values of the discrete-time state transition 
and control matrices A(7') and B(T) calculated in Example 9.8 may be used in the 
recursive solution. 

Continue the recursive steps until the solution settles down (when k = 50, or 
KT = 5 seconds) and hence determine the steady-state value of the feedback matrix 
K(0) and Riccati matrix P(0). What are the closed-loop eigenvalues? 


Solutions 
K(0) =[-—0.106 —0.581 0.064] 
11.474 3.406 0.153 


P(0)= | 3.406 3.952 0.163 
0.153 0.163 0.1086 


closed-loop eigenvalues =—1.230 


—4.816 + ¡2.974 


Example 9.10 
A unity-feedback control system has a nominal plant transfer function 


1 


and an integral controller in the forward path 
K 
C(s) = a (9.190) 
If the bound of the multiplicative model uncertainty is 


0.25(1 + 45) 


a) = 10259) 


(9.191) 
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determine: 


(a) Expressions for the sensitivity and complementary sensitivity function S(s) and 
T(s) for the nominal plant. 
(b) The maximum value that K can have for robust stability. 


Solutions 
s +75 + 105 
(a) S(s) = $+77+108+ K 
K 
T(s) = 
(s) $5+782+105+ K 
(b) Kmax =4.5 


Example 9.11 
A plant has a transfer function 


100 
s2+25+ 100 


and sensitivity and complementary weighting functions 


+ 100 
Ws(s) == (E 1 ) 


qe] 
eye (n) 


Find the optimal value for y and hence the state-space and transfer functions for the 
H.¿-optimal controller C(s). 


G(s) = 


Solutions 
Yopt = 0.0576 
—2.8 3.0 —1.4 150.9 4.55 
30 -—22.2 50.1 258.0 3.10 
A. B. 
C. De -2.7 39.6 —74.5 196.1 2.99 
32 36.3 23.2 —1871.1 7.44 
—0.33 1.68 1.02 —49.42 0 


1.86 x 10355 + 0.1898 x 1065? + 0.5581 x 10%5 + 18.6031 x 10% 


aus s* + 1.97 x 10353 + 0.2005 x 10652 + 1.3531 x 1065 + 1.1546 x 106 


10 


Intelligent control system 
design 


10.1 Intelligent control systems 


10.1.1 Intelligence in machines 


According to the Oxford dictionary, the word intelligence is derived from intellect, 
which is the faculty of knowing, reasoning and understanding. Intelligent behaviour 
is therefore the ability to reason, plan and learn, which in turn requires access to 
knowledge. 

Artificial Intelligence (AI) is a by-product of the Information Technology (1T) 
revolution, and is an attempt to replace human intelligence with machine intelli- 
gence. An intelligent control system combines the techniques from the fields of AI 
with those of control engineering to design autonomous systems that can sense, 
reason, plan, learn and act in an intelligent manner. Such a system should be able 
to achieve sustained desired behaviour under conditions of uncertainty, which 
include: 


(a) uncertainty in plant models 

(b) unpredictable environmental changes 

(c) incomplete, inconsistent or unreliable sensor information 
(d) actuator malfunction. 


10.1.2 Control system structure 


An intelligent control system, as considered by Johnson and Picton (1995), comprises 
of a number of subsystems as shown in Figure 10.1. 


The perception subsystem 
This collects information from the plant and the environment, and processes it into a 
form suitable for the cognition subsystem. The essential elements are: 


(a) Sensor array which provides raw data about the plant and the environment 

(b) Signal processing which transforms information into a suitable form 

(c) Data fusion which uses multidimensional data spaces to build representations of 
the plant and its environment. A key technology here is pattern recognition. 
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Intelligent Control System 


Cognition Actuation 


Perception 
Subsystem » Subsystem |] 


Subsystem 


Environment 


| Plant e 


Fig. 10.1 Intelligent control system structure (adapted from Johnson and Picton). 


The cognition subsystem 
Cognition in an intelligent control system is concerned with the decision making 
process under conditions of uncertainty. Key activities include: 


(a) Reasoning, using 
(1) knowledge-based systems 
(11) fuzzy logic 
(b) Strategic planning, using 
(1) optimum policy evaluation 
(11) adaptive search and genetic algorithms 
(111) path planning 
(c) Learning, using 
(1) supervised learning in neural networks 
(11) unsupervised learning in neural networks 
(111) adaptive learning 


The actuation subsystem 

The actuators operate using signals from the cognition subsystem in order to drive the 

plant to some desired states. In the event of actuator (or sensor) failure, an intelligent 

control system should be capable of being able to re-configure its control strategy. 
This chapter is mainly concerned with some of the processes that are contained 

within the cognition subsystem. 


10.2 Fuzzy logic control systems 


10.2.1 Fuzzy set theory 


Fuzzy logic was first proposed by Zadeh (1965) and is based on the concept of fuzzy 
sets. Fuzzy set theory provides a means for representing uncertainty. In general, 
probability theory is the primary tool for analysing uncertainty, and assumes that the 
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uncertainty is a random process. However, not all uncertainty is random, and fuzzy 
set theory is used to model the kind of uncertainty associated with imprecision, 
vagueness and lack of information. 

Conventional set theory distinguishes between those elements that are members of 
a set and those that are not, there being very clear, or crisp boundaries. Figure 10.2 
shows the crisp set “medium temperature”. Temperatures between 20 and 30*C lie 
within the crisp set, and have a membership value of one. 

The central concept of fuzzy set theory is that the membership function y, like 
probability theory, can have a value of between 0 and 1. In Figure 10.3, the member- 
ship function y has a linear relationship with the x-axis, called the universe of 
discourse U. This produces a triangular shaped fuzzy set. 

Fuzzy sets represented by symmetrical triangles are commonly used because they 
give good results and computation is simple. Other arrangements include non- 
symmetrical triangles, trapezoids, Gaussian and bell shaped curves. 

Let the fuzzy set “medium temperature” be called fuzzy set M. If an element u of the 
universe of discourse U lies within fuzzy set M, it will have a value of between 0 and 
1. This is expressed mathematically as 


uml) E [0,1] (10.1) 


When the universe of discourse is discrete and finite, fuzzy set M may be expressed as 
M => tama) (10.2) 
=l 


In equation (10.2) *” is a delimiter. Hence the numerator of each term is the member- 
ship value in fuzzy set M associated with the element of the universe indicated in the 
denominator. When n = 11, equation (10.2) can be written as 


M = 0/0 + 0/5 + 0/10 +0.33/15 + 0.67/20 + 1/25 + 0.67/30 + 0.33/35 


+ 0/40 + 0/45 + 0/50 (10.3) 
p Medium 
Temperature 
107 PA] 
Membership 


Function 0.8- 


0 10 20 30 40 50 
Temperature (*C) 


Fig. 10.2 Crisp set 'medium temperature”. 
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Medium 
Temperature 


Membership 
Function 


0 10 20 30 40 50 
Universe of Discourse (Temperature (*C)) 


Fig. 10.3 Fuzzy set 'medium temperature”. 


Note the symbol “+” is not an addition in the normal algebraic sense, but in fuzzy 
arithmetic denotes a union operation. 


10.2.2 Basic fuzzy set operations 


Let A and B be two fuzzy sets within a universe of discourse U with membership 
functions a and ¡ug respectively. The following fuzzy set operations can be defined as 


Equality: Two fuzzy sets A and B are equal if they have the same membership 
function within a universe of discourse U. 


pa(u) = ug(u) for all ue U (10.4) 


Union: The union of two fuzzy sets A and B corresponds to the Boolean OR function 
and is given by 


PauBlu) = pay gu) = max(pa(u), uglu), for all ue U (10.5) 


Intersection: The intersection of two fuzzy sets A and B corresponds to the Boolean 
AND function and is given by 


Langlu) = min[ya(u), uglu)) for all ue U (10.6) 


Complement: The complement of fuzzy set A corresponds to the Boolean NOT 
function and is given by 


uaa(u) = 1 — alu) for all ue U (10.7) 


Example 10.1 

Find the union and intersection of fuzzy set low temperature L and medium tem- 
perature M shown in Figure 10.4. Find also the complement of fuzzy set M. Using 
equation (10.2) the fuzzy sets for n= 11 are 
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Membership 
Function 


0 10 20 30 40 50 
Universe of Discourse (Temperature (*C)) 


Fig. 10.4 Overlapping sets low'and 'medium temperature”. 


L = 0/0 + 0.33/5 + 0.67/10 + 1/15 + 0.67/20 + 0.33/25 


0/30 + 0/35 + --- + 0/50 (10.8) 
M = 0/0 + 0/5 + 0/10 + 0.33/15 + 0.67/20 + 1/25 + 0.67/30 
+ 0.33/35 + 0/40 + --- +0/50 
(a) Union: Using equation (10.5) 
pL+m(u) = max(0, 0)/0 + max(0.33, 0)/5 + max(0.67, 0)/10 

+ max(1, 0.33)/15 + max(0.67, 0.67)/20 + max(0.33, 1)/25 

+ max(0, 0.67)/30 + max(0, 0.33)/35 + max(0, 0)/40+--- 

+ max(0, 0)/50 (10.9) 


uml) = 0/0 + 0.33/5 + 0.67/10 + 1/15 + 0.67/20 + 1/25 + 0.67/30 
+ 0.33/35 + 0/40 + --- + 0/50 (10.10) 


(b) Intersection: Using equation (10.6) and replacing “max” by 'min” in equation 
(10.9) gives 


unmlu) = 0/0 + 0/5 + 0/10 + 0.33/15 + 0.67/20 + 0.33/25 
+ 0/30 +---+0/50 (10.11) 
Equations (10.10) and (10.11) are shown in Figure 10.5. 


(c) Complement: Using equation (10.7) 
uml) = (1 — 0)/0 + (1—0)/5+(—0)/10 + (1 — 0.33)/15 
+ (1 — 0.67)/20 + (1 — 1)/25 + (1 — 0.67)/30 + (1 — 0.33)/35 
+ (1 -—0)/40+---+(1 — 0)/50 (10.12) 


Equation (10.12) is illustrated in Figure 10.6. 
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Membership 
Function 


0 10 20 30 40 50 
Temperature (*C) 


Membership 
Function 


0 10 20 30 40 50 
Temperature (*C) 


Fig. 10.6 The complement of fuzzy set M. 


10.2.3 Fuzzy relations 


An important aspect of fuzzy logic is the ability to relate sets with different universes 
of discourse. Consider the relationship 


IF L THEN M (10.13) 


In equation (10.13) L is known as the antecedent and M as the consequent. The 
relationship is denoted by 


A=LxM (10.14) 
or 


— | minfyL(4), ¿mO)) ... minf a (), amO); 
có minfyL (4), amO)... mint (4), amO) (10.15) 
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where u¡ —>u¡ and v, —> vz are the discretized universe of discourse. Consider the 
statement 
IF L is low THEN M is medium (10.16) 


Then for the fuzzy sets L and M defined by equation (10.8), for U from 5 to 35 in 
steps of 5 


min (0.33,0) ... min(0.33,1) ... min(0.33, 0.33) 
min (0.67,0) ... min(0.67,1) ... min(0.67, 0.33) 
LxM= t ' . , . (10.17) 
min(0,0) ... min(0,1) ...  min(0,0.33) 
which gives 

0 0 0.33 0.33 0.33 0.33 0.33 
0 0 0.33 0.67 0.67 0.67 0.33 
0 0 0.33 0.67 1 0.67 0.33 

LxM=|0 0 0.33 0.67 0.67 0.67 0.33 (10.18) 
0 0 0.33 0.33 0.33 0.33 0.33 
0.0.0 0 0 0 0 
0.0.0 0 0 0 0 


Several such statements would form a control strategy and would be linked by their 
union 


A=A¡+A>2+A3+-::+A, (10.19) 


10.2.4 Fuzzy logic control 


The basic structure of a Fuzzy Logic Control (FLC) system is shown in Figure 10.7. 


The fuzzification process 

Fuzzification is the process of mapping inputs to the FLC into fuzzy set membership 
values in the various input universes of discourse. Decisions need to be made 
regarding 


(a) number of inputs 
(b) size of universes of discourse 
(c) number and shape of fuzzy sets. 


A FLC that emulates a PD controller will be required to minimize the error e(t) and 
the rate of change of error de/dt, or ce. 

The size of the universes of discourse will depend upon the expected range (usually 
up to the saturation level) of the input variables. Assume for the system about to be 
considered that e has a range of +6 and ce a range of +1. 

The number and shape of fuzzy sets in a particular universe of discourse is a trade- 
off between precision of control action and real-time computational complexity. In 
this example, seven triangular sets will be used. 
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Fig. 10.7 Fuzzy Logic Control System. 


Each set is given a linguistic label to identify it, such as Positive Big (PB), Positive 
Medium (PM), Positive Small (PS), About Zero (Z), Negative Small (NS), Negative 
Medium (NM) and Negative Big (NB). The seven set fuzzy input windows for e and 
ce are shown in Figure 10.8. If at a particular instant, e(t) = 2.5 and de/dt = —0.2, 
then, from Figure 10.8, the input fuzzy set membership values are 


uipsle) =0.7  ppmle) = 0.4 


unsí[ce) =0.6  pz(ce) = 0.3 (10.20) 


The fuzzy rulebase 
The fuzzy rulebase consists of a set of antecedent—consequent linguistic rules of 
the form 


IF e is PS AND ce is NS THEN u is PS (0.21) 


This style of fuzzy conditional statement is often called a “Mamdani”-type rule, after 
Mamdani (1976) who first used it in a fuzzy rulebase to control steam plant. 

The rulebase is constructed using a priori knowledge from either one or all of the 
following sources: 


(a) Physical laws that govern the plant dynamics 
(b) Data from existing controllers 
(c) Imprecise heuristic knowledge obtained from experienced experts. 


If (c) above is used, then knowledge of the plant mathematical model is not required. 

The two seven set fuzzy input windows shown in Figure 10.8 gives a possible 7 x 7 
set of control rules of the form given in equation (10.21). It is convenient to tabulate 
the two-dimensional rulebase as shown in Figure 10.9. 


Fuzzy inference 

Figure 10.9 assumes that the output window contains seven fuzzy sets with the same 
linguistic labels as the input fuzzy sets. If the universe of discourse for the control 
signal u(t) is +9, then the output window is as shown in Figure 10.10. 
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Rate of Change Of Error (ce) 


Fig. 10.8 Seven set fuzzy input windows for error (e) and rate of change of error (ce). 
Assume that a certain rule in the rulebase is given by equation (10.22) 


OR IF eis A AND ce is B THEN u = C (10.22) 


From equation (10.5) the Boolean OR function becomes the fuzzy max operation, 
and from equation (10.6) the Boolean AND function becomes the fuzzy min oper- 
ation. Hence equation (10.22) can be written as 


ic(u) = max[ min (ua(e), ug(ce))] (10.23) 


Equation (10.23) is referred to as the max-min inference process or max—min fuzzy 
reasoning. 

In Figure 10.8 and equation (10.20) the fuzzy sets that were “hit” in the error input 
window when e(+) = 2.5 were PS and PM. In the rate of change input window when 
ce = —0.2, the fuzzy sets to be “hit” were NS and Z. From Figure 10.9, the relevant 
rules that correspond to these “hits” are 
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ES ú NB NM NS Z PS PM PB 
NB NB NB NB NM Z PM PB 
NM NB NB NB NM PS PM PB 
NS NB NB NM NS PS PM PB 
Z NB NM NS Z PS PM PB 
PS NB NM NS PS PM PB PB 
PM NB NM NS PM PB PB PB 
PB NB NM Z PM PB PB PB 


=3 0 3 6 
Control Signal (u) 


Fig. 10.10 Seven set fuzzy output window for control signal (u). 


. OR IF eis PS AND ce is NS 


OR IF e is PS AND ce is Z 
THEN u = PS 


. OR IF eis PM AND ce is NS 


OR IF e is PM and ce is Z 
THEN u = PM 


(10.24) 


(10.25) 


Intelligent control system design 335 


Applying the max—min inference process to equation (10.24) 
ups(u) = max[ min(ppste), puns(ce)), min(ups(e), puz(ce))] (10.26) 
inserting values from equation (10.20) 
Lps(u) = max[ min(0.7, 0.6), min(0.7,0.3)] 
= max[0.6, 0.3] =0.6 (10.27) 
Applying the max—min inference process to equation (10.25) 
Hem(u) = max] min(upm(e), uns(ce)), min(upmle), puz(ce))] (10.28) 
inserting values from equation (10.20) 
uem(u) = max[ min(0.4, 0.6), min(0.4, 0.3)] 
= max[0.4, 0.3] = 0.4 (10.29) 


Fuzzy inference 1s therefore the process of mapping membership values from the 
input windows, through the rulebase, to the output window(s). 


The defuzzification process 

Defuzzification is the procedure for mapping from a set of inferred fuzzy control 
signals contained within a fuzzy output window to a non-fuzzy (crisp) control signal. 
The centre of area method 1s the most well known defuzzification technique, which in 
linguistic terms can be expressed as 


Sum of first moments of area 


Crisp control signal = robar (10.30) 
For a continuous system, equation (10.30) becomes 
fujy(wdu 
u(t) = 5A=>— 10.31) 
O Tiana 
or alternatively, for a discrete system, equation (10.30) can be expressed as 
3 u¡p(u;) 
UKT) = LA 10.32 
a a 
For the case when e(t) = 2.5 and ce = —0.2, as a result of the max-min inference 


process (equations (10.27) and (10.29)), the fuzzy output window in Figure 10.10 is 
“clipped”, and takes the form shown in Figure 10.11. 
From Figure 10.11, using the equation for the area of a trapezoid 


0.6(6 + 2.4) 
2 


Areaps = = IZ 


(10.33) 


paOs O 


Areapm = 


From equation (10.30) 


_-(Q52x3)+(0.96x 6) 
ult) = 700 = 3.83 (10.34) 
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Fig. 10.11 Clipped fuzzy output window due to fuzzy inference. 


Hence, for given error of 2.5, and a rate of change of error of —0.2, the control signal 
from the fuzzy controller is 3.83. 


Example 10.2 
For the input and output fuzzy windows given in Figure 10.8 and 10.10, together 
with the fuzzy rulebase shown in Figure 10.9, determine 


(a) the membership values of the input windows e and ce. 
(b) the max—min fuzzy inference equations 
(c) the crisp control signal u(t) 


when e = —3 and ce =0.3 
Solution 
(a) When e = —3 and ce = 0.3 are mapped onto the input fuzzy windows, they are 


referred to as fuzzy singletons. From Figure 10.8 


e=-3 ums(e)=0.5 unmle) =0.5 (10.35) 


ce = 0.3, using similar triangles 


1 pee) 
0.33 (0.33 —0.3) 


pz (ce) = 0.09 (10.36) 


and 


_1 _ pstce) 
0.33 0.3 
upsíce) = 0.91 (10.37) 
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(b) The rules that are “hit” in the rulebase in Figure 10.9 are 


. OR IF eis NS and ce is Z 
OR IF eis NS and ce is PS 
THEN uy = NS (10.38) 


. OR IF e is NM and ce is Z 
OR IF e is NM and ce is PS 
THEN uy = NM (10.39) 


Applying max—min inference to equation (10.38) 
Hns(u) = max[ min(yys(e), uz(ce)), min(uus(e), ups(ce))] (10.40) 
Inserting values into (10.40) 


pius(u) = max[ min(0.5, 0.09), min(0.5, 0.91)] 


(10.41) 
= max[0.09, 0.5] = 0.5 


and similarly with equation (10.39) 


unm(u) = max[ min(unm(e), uz(ce)), min(unm(e), ups(ce))] 
= max[ min(0.5, 0.09), min(0.5, 0.91)] (10.42) 
= max(0.09,0.5] = 0.5 


Using equations (10.41) and (10.42) to “clip” the output window in Figure 10.10, the 
output window is now as illustrated in Figure 10.12. 


(c) Due to the symmetry of the output window in Figure 10.12, from observation, 
the crisp control signal is 


u(1) =-4,5 


Example 10.3 (See also Appendix 1, examp103.m) 
Design a fuzzy logic controller for the inverted pendulum system shown in Figure 
10.13 so that the pendulum remains in the vertical position. 

The inverted pendulum problem is a classic example of producing a stable closed- 
loop control system from an unstable plant. 

Since the system can be modelled, it is possible to design a controller using the pole 
placement techniques discussed in Chapter 8. Neglecting friction at the pivot and the 
wheels, the equations of motion from Johnson and Picton (1995) are 


ee m(6 sin 0 — Ócos 0) 


10.4 
Mim 0099 


: —F-—m(0? sin 0 
gsinO+cos 0(=EpiEsno) 


ml 2 (14m cos? Y 
3 M+m 


(10.44) 
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Fig. 10.12 Fuzzy output window for Example 10.2. 


M 


LO 777 


Fig. 10.13 An inverted pendulum. 


In equations (10.43) and (10.44), m is the mass and £ is the half-length of the 
pendulum and M is the mass of the trolley. F(£) is the applied force to the trolley 
in the x-direction. If it is assumed that 0 is small and second-order terms (6?) can be 
neglected, then 


. F-m0 
204 (55 
f= 80+ (seta) (10.46) 


l € => o) 
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If the state variables are 
xi =0, x=0, X3=x and x4=xX 
and the control variable is 
u= F(t) 


then from equations (10.45) and (10.46), the state equations become 


X1 0 1.0 0]Í[x1 0 
Xx |a 0.0 0]]|x ba 
A A a 00 
XA da] 0.00 Xa ba 
where 
q 3E(M +m) 
2 HAM +m)-— 3m) 
a —3gm 
“MAME mM=3m 
3 (10.48) 
iS UAM +m)- 3m) 
1 3m 
= —_—_—_——— 1 —_—_— 
ls Cl Famim) 5) 
and the output equation is 
y = Cx (10.49) 


where C is the identity matrix. For a regulator, with a scalar control variable 
u= —Kx 


The elements of K can be obtained by selecting a set of desired closed-loop poles as 
described in section 8.4.2, and applying one of the three techniques discussed. 
Data for simulation 


l(=1m M=1kg m=0.5kg 


3 x 9.81(1.5) 
E =9.81 
ARAS 
-3 x 9.81 x 0.5 
a 
ba ze 0.667 


“HUA IS=15 7 


1 1.5 
das (is) 0 +Haxt5)- 5) ió 
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If the required closed-loop poles are 
s = —2 +32 for the pendulum, and 
s = —4 534 for the trolley, then the closed-loop characteristic equation is 


+ 125 + 72? + 1925+ 256 =0 (10.50) 


Using Ackermann's Formula in equations (8.103) and (8.104), the state feedback 
matrix becomes 


K=[-174.83 57.12 -—39.14 -—29.36] (10.51) 


Using the fuzzy logic approach suggested by Johnson and Picton (1995), four, 
three set input windows (one for each state variable) and one, three set output 
window has been selected as shown in Figure 10.14. Using heuristic knowledge from 
broom-balancing experiments, the following Mamdani-type rulebase was con- 
structed: 


IF 6 is PB and 0 is PB then F is PB 
IF 0 is PB and 0 is Z then F is PB 
IF 0 is PB and 0 is NB then F is Z 
IF 0 is Z and 0 is PB then F is PB 
IF 0 is Z and 0 is Z then F is Z 

IF 0 is Z and 0 is NB then F is NB (10.52) 
IF 6 is NB and 0 is PB then F is Z 
IF 0 is NB and 0 is Z then F is NB 
IF 9 is NB and 0 is NB then F is NB 
IF 6 is PB then F is PB 

11. IF 0 is NB then F is NB 


> A E AE 


> 


The rulebase can be extended up to 22 rules by a further set of 11 rules replacing 0 
with x and 0 with x. 
For the rulebase given in equation (10.52), the fuzzy max—min inference process is 


pg (w) = max[upg(Ó), min(yp(0), pg (Ó)), min(upr(0), 1uz(Ó)), min(yuz(0), pg (Ó))] 
ing (u) = max[ung(Ó), min(yz(0), ng (Ó)), min(yung(0), z(0)), min(ug(0), nz (Ó))] 
yuz(u) = max[min(gpr(9), (6), min(uz(0), z(Ó)), min(ung(0), pr (Ó))] 


Again, a similar inference process occurs with x and x. Following defuzzification, 
a crisp control force F(t) is obtained. 

Figure 10.15 shows the time response of the inverted pendulum state variables 
from an initial condition of 9 = 0.1 radians. On each graph, three control strategies 
are shown, the 11 set rulebase of equation (10.52), the 22 set rulebase that includes 
x and x, and the state feedback method given by equation (10.51). 

For the pendulum angle, shown in Figure 10.15(a), the 11 set rulebase gives the 
best results, the state feedback being oscillatory and the 22 set rulebase diverging 
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Fig. 10.14 Input and output fuzzy windows for the inverted pendulum problem. 


after a while. The same comments apply to the pendulum angular rate, given in 
Figure 10.15(b). 

With the trolley displacement and velocity shown in Figures 10.15(c) and (d), the 
state feedback, although oscillatory, give the best results since there is no steady-state 
error. The positional error for both rulebases increases with time, and there is a 
constant velocity steady-state error for the 11 set rulebase, and increasing error for 
the 22 set rulebase. Figure 10.15(e) shows the control force for each of the three 
strategles. 

The 11 and 22 set rulebase simulations were undertaken using SIMULINK, 
together with the fuzzy logic toolbox for use with MATLAB. More details on the 
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(Fig. 10.15 continued) 
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Fig. 10.15 Inverted pendulum state variable time response for three control strategies. 


MATLAB Fuzzy Inference System (FIS) editor can be found in Appendix 1. Figure 
10.16 shows the control surface for the 11 set rulebase fuzzy logic controller. 


10.2.5 Self-organizing fuzzy logic control 


Self-Organizing Fuzzy Logic Control (SOFLC) is an optimization strategy to create 
and modify the control rulebase for a FLC as a result of observed system 
performance. The SOFLC is particularly useful when the plant is subject to time- 
varying parameter changes and unknown disturbances. 


Structure 
A SOFLC is a two-level hierarchical control system that is comprised of: 


(a) a learning element at the top level 
(b) a FLC at the bottom level. 


The learning element consists of a Performance Index (PI) table combined with a rule 
generation and modification algorithm, which creates new rules, or modifies existing 
ones. The structure of a SOFLC is shown in Figure 10.17. With SOFLC it is usual to 
express the PI table and rulebase in numerical, rather than linguistic format. So, for 
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Fig. 10.16 Control surface for 11 set rulebase fuzzy logic controller. 


Performance 
Index Table 


ss 


Rule Generation 
and Modification 


¿| Data Rule |: 
:| Base | Base |: 


d+ ell): 70 c(t) 
— (2) — > Fuzzification Lp , FUZZy || Defuzzification > Plant 


Measurement 
System 


Fig. 10.17 Self-Organizing Fuzzy Logic Control system. 
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NM NS Z PS PM PB 
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8 2 12 22 32 42 

PB -10 0 10 20 30 40 50 


Fig. 10.18 Tabular structure of a numerical fuzzy rulebase. 


example, the fuzzy rulebase in Figure 10.9, might take the form as shown in Figure 
10.18. 


Rulebase modification 
If the numerical structure of the fuzzy rulebase does not give an acceptable response, 
then the values in certain cells will need to be adjusted. 

Let the error, rate of change of error and control signal at time 1 be e(t), ce(t) and 
u(t) respectively, and assume that a given Pl is a function of e(t) and ce(lt). 

If there are unacceptable errors at time 1, because of the dynamics of the plant, 
these will be as a result of control action taken d seconds previously, or at time 
(t— d). The parameter dis a “delay in reward” parameter and is related to the settling 
time of the plant, having a typical value of between 37' and ST, where T is the 
dominant time constant of the plant. 

The value of the Pl is therefore determined using e(t — d) and ce(t — d) and applied 
to u(t) as a correction factor to the rulebase in the form 


IF e(0) is ... and ce(0) is ... THEN u(1) =--- +PI (10.53) 


where the PI is read from a Performance Index table of the form shown in Figure 
10.19. When the values of e(t — d) and ce(t — d) are within an acceptable range, the 
PI tends to zero and the fuzzy rulebase settles down and convergence for the self- 
organizing process has been achieved. The PI table is usually designed heuristically, 
based upon an intuitive understanding of the learning process, and the trade-off 
between speed of learning and stability of the rulebase. 
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pa Ñ NB NM NS Z PS PM PB 
NB 5 4 3 3 2 1 0 
NM 4 3 3 2 1 0 1 
NS 3 3 2 1 0 1 2 
Z 3 2 1 0 il 2 3 
PS 2 1 0 1 2 3 3 
PM 1 0 1 2 3 3 4 
PB 0 1 2 3 3 4 5 


Fig. 10.19 Performance Index table. 


10.3 Neural network control systems 


10.3.1 Artificial neural networks 


The human brain is comprised of many millions of interconnected units, known 
individually as biological neurons. Each neuron consists of a cell to which is attached 
several dendrites (inputs) and a single axon (output). The axon connects to many 
other neurons via connection points called synapses. A synapse produces a chemical 
reaction in response to an input. The biological neuron “fires” if the sum of the 
synaptic reactions is sufficiently large. The brain is a complex network of sensory 
and motor neurons that provide a human being with the capacity to remember, 
think, learn and reason. 

Artificial Neural Networks (ANNSs) attempt to emulate their biological counter- 
parts. McCulloch and Pitts (1943) proposed a simple model of a neuron, and Hebb 
(1949) described a technique which became known as “Hebbian” learning. Rosenblatt 
(1961), devised a single layer of neurons, called a Perceptron, that was used for 
optical pattern recognition. 

One of the first applications of this technology for control purposes was by 
Widrow and Smith (1964). They developed an ADaptive LINear Element 
(ADLINE) that was taught to stabilize and control an inverted pendulum. Kohonen 
(1988) and Anderson (1972) investigated similar areas, looking into “associative” 
and “interactive” memory, and also “competitive learning”. The back propagation 
training algorithm was investigated by Werbos (1974) and further developed by 
Rumelhart (1986) and others, leading to the concept of the Multi-Layer Perceptron 
(MLP). 
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Artificial Neural Networks have the following potential advantages for intelligent 
control: 


They learn from experience rather than by programming. 

They have the ability to generalize from given training data to unseen data. 
They are fast, and can be implemented in real-time. 

They fail “gracefully” rather than *catastrophically”. 


10.3.2 Operation of a single artificial neuron 


The basic model of a single artificial neuron consists of a weighted summer and an 
activation (or transfer) function as shown in Figure 10.20. Figure 10.20 shows a 
neuron in the jth layer, where 


X¡...x¡ are inputs 
W;1 ... w; are weights 
b, 1s a bias 


f; 1s the activation function 
y, is the output 


The weighted sum s; is therefore 
N 
s¡(0) = Y wyx0) +) (10.54) 
i=l 


Equation (10.54) can be written in matrix form 
si(t) = W, x+ bj (10.55) 


The activation function f(s) (where s is the weighted sum) can take many forms, some 
of which are shown in Figure 10.21. From Figure 10.21 it can be seen that the bias bj 
in equations (10.54) and (10.55) will move the curve along the s axis, 1.e. effectively 


Synaptic 
bias b) Connections 


Activation 
function 


X1 


y; 


X2 


Weighted 
Summer 


Xi; 


W; 


Fig. 10.20 Basic model of a single artificial neuron. 
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setting the threshold at which the neuron “fires”. So in the case of the hard-limiting 
function, if b; = 0, the neuron will “fire” when s;(t) changes from negative to positive. 

The sigmoid activation function is popular for neural network applications since it 
is differentiable and monotonic, both of which are a requirement for the back- 
propagation algorithm. The equation for a sigmoid function is 


Ms) = 


10. 
14 e is 


10.3.3 Network architecture 


Feedforward networks 
An ANN is a network of single neurons jointed together by synaptic connections. 
Figure 10.22 shows a three-layer feedforward neural network. 

The feedforward network shown in Figure 10.22 consists of a three neuron input 
layer, a two neuron output layer and a four neuron intermediate layer, called a 
hidden layer. Note that all neurons in a particular layer are fully connected to all 
neurons in the subsequent layer. This is generally called a fully connected multilayer 
network, and there is no restriction on the number of neurons in each layer, and no 
restriction on the number of hidden layers. 


f(s) f(s) 
1.0:=+ 
1.0 
Ss Ss 
(a) Hard-Limiting (Unit Step) (b) Linear (Ramp) 
f(s) f(s) 
1.0 10+ 
Ss 
1.0 
Ss 
(c) Hyperbolic Tangent (d) Sigmoid 


Fig. 10.21 Activation functions. 
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Fig. 10.22 Three-layer feedforward neural network. 


Feedback (recurrent) networks 
Recurrent networks are based on the work of Hopfield and contain feedback paths. 
Figure 10.23 shows a single-layer fully-connected recurrent network with a delay 
(270) in the feedback path. 

If, in Figure 10.23, the inputs occur at time (kT) and the outputs are predicted at 
time (k + 1)7, then the network can be represented in matrix form by 


y +1)T = W¡y(«T) + Wox(KT) (10.57) 


Equation (10.57) is in the same form as the discrete-time solution of the state 
equation (8.76). 


10.3.4 Learning in neural networks 


Learning in the context of a neural network is the process of adjusting the weights 
and biases in such a manner that for given inputs, the correct responses, or outputs 
are achieved. Learning algorithms include: 


(a) Supervised learning: The network is presented with training data that represents 
the range of input possibilities, together with the associated desired outputs. The 
welghts are adjusted until the error between the actual and desired outputs meets 
some given minimum value. 

Unsupervised learning: Also called open-loop adaption because the technique 
does not use feedback information to update the network”s parameters. Applica- 
tions for unsupervised learning include speech recognition and image compres- 
sion. Important unsupervised networks include the Kohonen Self-Organizing 
Map (KSOM) which is a competitive network, and the Grossberg Adaptive 
Resonance Theory (ART), which can be used for on-line learning. 


(b 


== 
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Fig. 10.23 Recurrent neural network. 


10.3.5 Back-Propagation 


The Back-Propagation Algorithm (BPA) is a supervised learning method for training 
ANNSs, and is one of the most common forms of training techniques. It uses a 
gradient-descent optimization method, also referred to as the delta rule when applied 
to feedforward networks. A feedforward network that has employed the delta rule 
for training, is called a Multi-Layer Perceptron (MLP). 

If the performance index or cost function J takes the form of a summed squared 
error function, then 


1 M 
=> > (d; — y¡Y (10.58) 
¿al 


where d; and y; are the desired and actual network outputs respectively. Using 
rod: descent, the weight increment Aw; is proportional to the (negative) slope 


OJ 


AWwi = =p — 
úl OWi 


(10.59) 


where y is a constant. From equations (10.58) and (10.59), 


>: 7 a yy 
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using the chain rule, 


Ei 
OWi MF Oy; J J wi 
glving 
oJ e Oy; 
= cd 10. 
2 m2 0 DAA (10.60) 


If the activation function is the sigmoid function given in equation (10.56), then its 
derivative is 


Y es 1 i- N$ 
Os — (l+es? 1+e5 L+e75 
Or 


El =f(5) - fs (10.61) 


Since f(s) is the neuron output y;, then equation (10.61) can be written as 


Oy; _ 
AU (10.62) 


From equation (10.60), again using the chain rule, 


Oy; E Oy; Os; 
Ow;; Os; Ow;; 


(10.63) 


If, in equation (10.54), the bias b; is called w;o, then equation (10.54) may be 


written as 
N 
5; = y WjX; (10.64) 
¡=0 
thus 
A A ws 
E O X= ¡= Xi 10.65 
Mw 2 E ¡id 


Substituting equations (10.62) and (10.65) into (10.63) gives 


OY; 
DW; 


= y ¡0 — y;¡)x; (10.66) 
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Putting equation (10.66) into (10.60) gives 


0J pa 
78 M2 (d — yy j0 — y pos (10.67) 
or 
2.7 E Ó;xi (10.68) 
where 
0 = (d; — y¡)y ¡(11 — yy) (10.69) 


Substituting equation (10.68) into (10.59) gives 


M 
Aw; =9D _ 6,x; (10.70) 
j=1 


where 
_2u 
MM 
This leads to a weight increment, called the delta rule, for a particular neuron 


Awi(kT) = 186/x; (10.71) 


where yn is the learning rate and has a value of between 0 and 1. Hence the new weight 
becomes 


wi(kT) = wy(k— D)T + Awi(kT) 
or 


wi(kT) = w¡(k — 1)T + 1ó6;x; (10.72) 


Consider a three layer network. Let the input layer be layer one (£ = 1), the hidden 
layer be layer two (4 =2) and the output layer be layer three (4 = 3). The back- 
propagation commences with layer three where d; is known and hence ó; can be 
calculated using equation (10.69), and the weights adjusted using equation (10.71). 
To adjust the weights on the hidden layer (4 = 2) equation (10.69) is replaced by 


N 
[6], = [»,(1 — yp)] [E 5 (10.73) 
l+1 
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Hence the ó values for layer £ are calculated using the neuron outputs from layer £ 
(hidden layer) together with the summation of w and ó6 products from layer £+ 1 
(output layer). The back-propagation process continues until all weights have been 
adjusted. Then, using a new set of inputs, information is fed forward through the 
network (using the new weights) and errors at the output layer computed. The 
process continues until 


(1) the performance index J reaches an acceptable low value 
(11) a maximum iteration count (number of epochs) has been exceeded 
(111) a training-time period has been exceeded. 


For either (11) or (111), 1t may well be that a local minima has been located. Under these 
conditions the BPA may be re-started, and if again unsuccessful, a new training set 
may be required. 

The equations that govern the BPA can be summarized as 


Single neuron summation 


N 
5 = Y ws + by (10.74) 
Sigmoid activation function 
1 
E == 1 . 
a (10.75) 
Delta rule 
Awj(kT) = nó;X; (10.76) 
New weight 
wWi(KT) = wy(k — 1)T + Awj(kT) (10.77) 
Output layer 
Ó = y¡ (1 — y Md — yy) (10.78) 
12€ ñ 
=3_ (4-3) (10.79) 
j=l 


Other layers 


[6], = [y;(1 — y))] [Ea (10.80) 


(+1 


Learning with momentum 
When momentum is used in the BPA, the solution stands less chance of becoming 
trapped in local minima. It can be included by making the current change in weight 
equal to a proportion of the previous weight change summed with the weight change 
calculated using the delta rule. 
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The delta rule given in equation (10.76) can be modified to include momentum as 
indicated in equation (10.81). 


Awi(kT) = (1 — 0)n6¡x; + 0Awjy(k — 197 (10.81) 


where o is the momentum coefficient, and has a value of between 0 and 1. 


Example 10.4 
The neural network shown in Figure 10.24 is in the process of being trained using a 
BPA. The current inputs x, and x, have values of 0.2 and 0.6 respectively, and the 
desired output d; = 1. The existing weights and biases are 

Hidden layer 


LO 15 1.0 
w,=|0.5 2.0] b;=|-0,5 
2.5 30 1.5 


Output layer 
(1=2) 


Hidden layer 
(t=1) 


Xo=1 


Input layer 
(1=0) 


Fig. 10.24 Training using back-propagation. 
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Output layer 
Ww,=1[3.0 2.0 1.0] b,=[-4.0] 


Calculate the output y; and hence the new values for the weights and biases. Assume 
a learning rate of 0.5. 


Solution 
Forward propagation 
Hidden layer (4 = 1): Single neuron summation 
j == $1 = W10 + W11X1 T— W12X2 


j Ze $2 = W20 T W21X] T— W22X2 


j=3: $3 =W30 + W3/X] + W32X2 


$1 wW11 W12 e wW10 
$2 | = | Wa W>a2 E | + |Wo (10.82) 
53 wW31 W3 e W30 


Sigmoid activation functions (j= 1 to 3) 


or 


1 1 1 
= = = 1 . 
Mira Pte. "Tres 095) 
Output layer (£ = 2) 
j=l: 5 = Wo + W11Y1 + W12)2 + W13)3 (10.84) 
1 
RS (10.85) 
Inserting values into equations (10.82) and (10.83) 
S] 1.0 1.5 1.0 
s|=|05 2.0 [o] + | -0.5 
53 2.5 3.0 j 1.5 
Ss] = 2.1 $2 = 0.8 $3 = 3.8 
y = 0.891 y2=0.690 — y3=0.978 
Inserting values into equations (10.84) and (10.85) 
s=1.031  y;=y1 =0.737 (10.86) 


Back propagation 
Output layer (£ = 2): From equation (10.69) 


0; = yi(l — y¡Md; — y;) 
Since ¡=1 
81 =0.737(1 — 0.737)(1 — 0.737) 
= 0.051 (10.87) 
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Delta rule 


Awi(kT) = nóX; 
Awo =0.5 x 0.051 x 1 =0.0255 
Awj1 = 0.5 x 0.051 x 0.891 = 0.0227 
Aw =0.5 x 0.051 x 0.69 = 0.0176 
Aw13 = 0.5 x 0.051 x 0.978 = 0.0249 


New weights and biases for output layer 


w; =[3.0227 2.0176 1.0249] b;,=|[-3.975] (10.88) 


Hidden layer (£ = 1): From equation (10.80) 


[5], = [y;(1 — y,)] 1 161 


é+1 


To illustrate this equation, had there been two neurons in layer (4 + 1), 1.e. the output 
layer, then values for 6, and ó, for layer (£ + 1) would have been calculated. Thus, for 
layer £ (the hidden layer), the [0;], values would be 


j=1 1611, =D1(0 — y1)1,[w1101 + w216212, 1 
j=2: 1621, = [y(1 — y2)1,[w1201 + w226217, 1 
J=3: [63l, = [y3( — y3)1,[w1301 + w230212,1 


However, since in this example there is only a single neuron in layer (£ + 1), 6, =0. 
Thus the ó values for layer £ are 


j=1: [61], =[0.891(1 — 0.891)][3.0227 x 0.051] = 0.015 
¡=2: [62], = [0.690(1 — 0.690)][2.0176 x 0.051] = 0.022 (10.89) 
j=3: [63], =[0.978(1 — 0.978)][1.0249 x 0.051] = 0.001 


Hence, using the delta rule, the weight increments for the hidden layer are 


Awjo = 0.5 x 0.015 x 1 = 0.0075 
Aw1 = 0.5 x 0.015 x 0.2 = 0.0015 
Awj2 = 0.5 x 0.015 x 0.6 = 0.0045 
Awzo = 0.5 x 0.022 x 1 = 0.0110 
Aw¡ = 0.5 x 0.022 x 0.2 = 0.0022 
Aw2, = 0.5 x 0.022 x 0.6 = 0.0066 
Awso = 0.5 x 0.001 x 1 = 0.0005 
Aw3 = 0.5 x 0.001 x 0.2 = 0.0001 
Aw32 = 0.5 x 0.001 x 0.6 = 0.0003 
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The new weights and biases for the hidden layer now become 


1.0015 1.5045 1.0075 
W,= [0.5022 2.0066 | b;= | —0.489 (10.90) 
2.5001 3.0003 1.5005 


10.3.6 Application of neural networks to modelling, estimation 
and control 


An interesting and important feature of a neural network trained using back-propa- 
gation is that no knowledge of the process it is being trained to emulate is required. 
Also, since they learn from experience rather than programming, their use may be 
considered to be a “black box” approach. 


Neural networks in modelling and estimation 

Providing input/output data is available, a neural network may be used to model the 
dynamics of an unknown plant. There is no constraint as to whether the plant is 
linear or nonlinear, providing that the training data covers the whole envelope of 
plant operation. 

Consider the neural network state observer shown in Figure 10.25. This is similar 
in operation to the Luenberge full-order state observer given in Figure 8.9. If the 
neural network in Figure 10.25 is trained using back-propagation, the algorithm will 
minimize the PI 


N 
J=Y (YT) — KT) (YUT) — YT) (10.91) 
k=1 


Richter et al. (1997) used this technique to model the dynamic characteristics 
of a ship. The vessel was based on the Mariner Hull and had a length of 161 m 
and a displacement of 17000 tonnes. The training data was provided by a three 
degree-of-freedom (forward velocity, or surge, lateral velocity, or sway and turn, or 


u(kT) y(kT) 
¡==>> Plant > 
y(kT)-Y(KT) 5] 
YT) 


Neural 
Network 


> X(KT) 


Fig. 10.25 Neural network state observer. 
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yaw-rate) differential equation model produced by Burns and was based on previous 
work by Morse and Price. 

The training file consisted of input data of the form: Time elapsed +(kT), Rudder 
angle ó(kT'), Engine speed n(kT) with corresponding output data Forward velocity 
u(kT), Lateral velocity (kT), Yaw-rate r(kT). 

With the engine speed held constant, the rudder was given step changes of 0*, 
109, +20? and +307. Figure 10.26 shows training and trained data for a rudder 
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Fig. 10.26 Training and trained data for a neural network model of a Ship's Hull. 


angle of +20? (where positive is to port, or left). The input and output data was 
sampled every 5 seconds, during the transient period of the turn (0-300 seconds). 

The selected network had a 3-6-6-6-3 structure, i.e. input and output layers 
comprising 3 neurons in each, separated by three hidden layers of 6 neurons. During 
learning, 4 million epochs were trained. The learning rate and momentum were 
initially set at 0.3 and 0.8, but were reduced in three steps to final values of 0.05 
and 0.4 respectively. 


Inverse models 
The inverse model of a plant provides a control vector u(kT) for a given output 
vector y(kT') as shown in Figure 10.27. 


u(kT) y(kT) 
> 


Plant 


Neural 
Network 


Fig. 10.27 Neural network plant inverse model. 
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Fig. 10.28 Training a neural network controller. 


So, for example, with the ship model shown in Figure 10.26, the inverse model could 
be trained with time, forward velocity, lateral velocity and yaw-rate as input data and 
rudder angle and engine speed as output data. 


Neural networks in control 

Controller emulation: A simple application in control is the use of neural networks to 
emulate the operation of existing controllers. It may be that a nonlinear plant 
requires several tuned PID controllers to operate over the full range of control 
actions. Or again, an LQ optimal controller has difficulty in running in real-time. 
Figure 10.28 shows how the control signal from an existing controller may be used to 
train, and to finally be replaced by, a neural network controller. 


Error back-propagation through plant model 

All closed-loop control systems operate by measuring the error between desired 
inputs and actual outputs. This does not, in itself, generate control action errors that 
may be back-propagated to train a neural network controller. If, however, a neural 
network of the plant exists, back-propagation through this network of the system 
error (r(kT) — y(kT)) will provide the necessary control action errors to train the 
neural network controller as shown in Figure 10.29. 


Internal Model Control (IMC) 

Internal Model Control was discussed in relation to robust control in section 9.6.3 
and Figure 9.19. The IMC structure is also applicable to neural network control. The 
plant model G,,(s) in Figure 9.19 is replaced by a neural network model and the 
controller C(s) by an inverse neural network plant model as shown in Figure 10.30. 


10.3.7 Neurofuzzy control 


Neurofuzzy control combines the mapping and learning ability of an artificial neural 
network with the linguistic and fuzzy inference advantages of fuzzy logic. Thus 
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Fig. 10.29 Control action error generated by system error back-propagation through plant model. 
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Fig. 10.30 Application of neural networks to IMC. 


a neurofuzzy controller has the potential to out-perform conventional ANN or fuzzy 
logic controllers. The general architecture of a neurofuzzy scheme is to employ neural 
network learning to upgrade either the membership functions or rulebase of the fuzzy 
logic element. 


The Adaptive Network based Fuzzy Inference System (ANFIS) 

The ANFIS neurofuzzy controller was implemented by Jang (1993) and employs 
a Takagi-Sugeno-Kang (TSK) fuzzy inference system. The basic ANFIS architecture 
is shown in Figure 10.31. 

Square nodes in the ANFIS structure denote parameter sets of the membership 
functions of the TSK fuzzy system. Circular nodes are static/non-modifiable and 
perform operations such as product or max/min calculations. A hybrid learning rule 
is used to accelerate parameter adaption. This uses sequential least squares in the 
forward pass to identify consequent parameters, and back-propagation in the back- 
ward pass to establish the premise parameters. 
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Fig. 10.31 The Adaptive Network based Fuzzy Inference System (ANFIS) architecture (after Craven). 


If the fuzzy inference system has inputs x, and x2 and output fas shown in Figure 
10.31, then a first-order TSK rulebase might be 


Rule 1: Tf x¡ is 41 and x> is B;¡ 
then f =p1X1 +q1%X2 +11 
Rule 2: Tf x1 is 4, and x> is B> 
then f2 = p2X1 + q2X2 +12 
Rule n: If x, is 4, and x> is B,, 
then f, = PnX1 + qnX2 + Fn (10.92) 


Where 4¡...4An, Bi... B, are membership functions and pj]...Pn,q1---qn and 
ri ...r, are constants within the consequent functions. 

Layer 1 contains adaptive nodes that require suitable premise membership func- 
tions (triangular, trapezoidal, bell, etc). Hence 


Y1,i = gi(xi) (10.93) 
Layer 2 undertakes a product or T-norm operation. 
Yaoi =W= pair )gi(xo) ... pin) 1=1,2...,2n (10.94) 


Layer 3 calculates the ratio of the firing strength of the rules 


a w; 
Yi =W:= Ss 


i=1 Wi 


(10.95) 
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Layer 4 generates the linear consequent functions as given in equation (10.92). Layer 
5 sums all incoming signals 


9si=f= Y mf= (10.96) 
E=f yy wi; 


A limitation of the ANFIS technique is that it cannot be employed on multivariable 
systems. The Co-active ANFIS (CANFIS) developed by Craven (1999) extends the 
ANFIS architecture to provide a flexible multivariable control environment. This 
was employed to control the yaw and roll channels of an Autonomous Underwater 
Vehicle (AUV) simultaneously. 


Predictive Self-Organizing Fuzzy Logic Control (PSOFLC) 

This is an extension of the SOFLC strategy discussed in section 10.2.5 and illustrated 
in Figure 10.17. Predictive Self-Organizing Fuzzy Logic Control is particularly useful 
when the plant dynamics are time-varying, and the general architecture is shown in 
Figure 10.32. 

In Figure 10.30 the predictive neural network model tracks the changing dynamics 
of the plant. Following a suitable time delay, em(kT') 1s passed to the performance 
index table. If this indicates poor performance as a result of changed plant dynamics, 
the rulebase is adjusted accordingly. Richter (2000) demonstrated that this technique 
could improve and stabilize a SOFLC when applied to the autopilot of a small 
motorized surface vessel. 


—> Pl 
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Fig. 10.32 Predictive Self-Organizing Fuzzy Logic Control (PSOFLC). 
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10.4 Genetic algorithms and their application to control 
system design 


10.4.1 Evolutionary design techniques 


In any design problem there is a multi- dimensional space of possible solutions. Some 
of these solutions may be acceptable, but not the best (local optima) and there may 
exist a single best solution (global optimum). 

It has been shown in Chapter 9 that it is possible to obtain an optimal mathemat- 
ical solution for a control system with linear plant dynamics. An alternative 
approach is to use “heuristics”, or knowledge acquired through experience, to search 
for optimal solutions. One such technique is to employ a Genetic Algorithm (GA). 
This is a search algorithm based upon the evolutional process of natural selection of 
the fittest members of a given population to breed the next generation. 


10.4.2 The genetic algorithm (GA) 


In the early 1960s Rechenburg (1965) conducted studies at the Technical University 
of Berlin in the use of an evolutionary strategy to minimize drag on a steel plate. 
Genetic algorithms were used by Holland (1975) and his students at the University of 
Michigan in the late 1970s and early 1980s to analyse a range of engineering 
problems. In particular, Goldberg (1983) used GAs to optimize the design of gas 
pipeline systems. 

The basic element of a GA is the chromosome. This contains the genetic inform- 
ation for a given solution and is typically coded as a binary string. For example, an 
eight digit binary number such as 11001001 represents a chromosome that contains 
eight genes. Initially, a population of chromosomes, created randomly, represent 
a number of solutions to a given problem. 

A “fitness function”, which is in effect a performance index, is used to select the best 
solutions in the population to be parents to the offsprings that will comprise the next 
generation. The fitter the parent, the greater the probability of selection. This 
emulates the evolutionary process of “survival of the fittest”. Parents are selected 
using a roulette wheel method as shown in Figure 10.33. Here there are four 
candidate parents P1, P2, P3 and P4, having selection probabilities (from the fitness 
function) of 0.5, 0.3, 0.15 and 0.05 respectively. For the example in Figure 10.33, 1f 
the roulette wheel is spun four times, P1 may be selected twice, P2 and P3 once, and 
P4 not at all. 

Offsprings are produced by selecting parent chromosomes for breeding, and cross- 
ing over some of the genetic material. The amount of genetic material passed from 
parent to offspring is dictated by the random selection of a crossover point as indicated 
in Figure 10.34, where P1 and P2 are the parents, and 01 and 02 the offsprings. 

Mutation is allowed to occur in some of the offsprings, the amount being con- 
trolled by the mutation rate, typically a very small number. This results in the 
random change in a gene in an offspring, 1.e. from 0 to 1. 

The breeding of successive generations continues until all offsprings are acceptably 
fit. In some cases, all offsprings will eventually have the same genetic structure, 
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Fig. 10.34 Genetic material transfer during breeding. 


representing a global optimum, or in other cases, several solutions, called clustering 
may evolve. In this latter case, the system designer makes the decision as to which is 
the best solution. 


Example 10.5 
A system has a fitness function 


J=1+sinax (10.97) 


as shown in Figure 10.35. Assume that the solution space has 31 values and that each 
solution can be represented by a five digit binary string ranging from 00000 to 11111. 
The value of a in equation (10.97) is therefore 11.6? (0.203 rad). If the population has 
four members, spinning a coin (heads = 1, tails = 0) produced the following initial 
population 


00101 11110 00001 00011 
Determine the offsprings from the initial generation and the subsequent generation. 


Solution 
From Figure 10.35 it can be seen that the optimal solution occurs when x¡p = 8, or 
x2 = 01000. 

Table 10.1 shows the selection of parents for mating from the initial population. If 
a random number generator is used to generate numbers between 0.0 and 1.0, then 
the cumulative probability values in Table 10.1 is used as follows: 


Values between 0 and 0.342, Parent 1 selected 
Values between 0.343 and 0.488, Parent 2 selected 
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Fig. 10.35 Fitness function for Example 10.5. 


Table 10.1 Selection of parents for mating from initial population 


Parent X2 xo J=fG0) p=J/2J  Cumulative Roulette 
probability wheel hits 

1 00101 5 1.848 0.342 0.342 2 

2 11110 30 0.792 0.146 0.488 1 

3 00001 1 1.201 0.222 0.710 0 

4 00011 3 1.571 0.290 1.000 1 

Total 5.412 1.000 4 

Mean 1.353 0.250 1 

Maximum 1.848 0.342 2 


Values between 0.489 and 0.710, Parent 3 selected 
Values between 0.711 and 1.000, Parent 4 selected 


The random number generator produced the following values: 0.326, 0.412, 0.862 
and 0.067. Hence Parent 1 was selected twice, Parents 2 and 4 once and Parent 3 not 
at all. The selected parents were randomly mated with random choice of crossover 
points. The fitness of the first generation of offsprings is shown in Table 10.2. 

From Tables 10.1 and 10.2 the total fitness of the initial population was 5.412, 
whereas the total fitness of their offsprings was 5.956, an increase of 10%. Note that 
if each offspring was perfect, they would have a value of 810, or 01000), thus giving 
the maximum fitness that any population could have of 2 x 4= 8.0. 

The next spin of the random number generator produced values: 0.814, 0.236, 
0.481 and 0.712, giving the roulette wheel hits shown in Table 10.2. 

The second generation of offsprings is shown in Table 10.3. From Table 10.3 the 
total fitness of the second generation of offsprings is 7.204, or an increase of 33% 
above the initial population. As things stand, since the two most significant binary 
digits in the second generation offsprings are 00, subsequent breeding will not 
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Table 10.2 Fitness of first generation of offsprings 


Parent Breeding Offspring X2 xo J=f(0) p=J/NJ  Cumulative Roulette 
probability wheel hits 

1 sar 1 00110 6 1.937 0.325 0.325 1 

2 111110 2 11101. 29 0.600 0.101 0.426 

1 a 3 00011 3 1.571 0.264 0.690 1 

4 00011 4 00101 5 1.848 0.310 1.000 2 

Total 5.956 1.000 

Mean 1.489 0.250 

Maximum 1.937 0.325 


Table 10.3 Fitness of second generation of offsprings 


Parent Breeding Offspring X2 xo J=f(x) 
1 > 1 00101 5 1.848 
4 00101 2 00110 6 1.937 
3 1 3 00101 5 1.848 
4 00101 4 00011 3 1.571 
Total 7.204 
Mean 1.801 


Maximum 1.937 


produce strings greater than 00111, or 710. If all four offsprings had this value, then a 
total fitness for the population would be 7.953, which is close to, but not the ideal 
fitness of 8.0 as explained earlier. However, if mutation in a particular offspring 
changed one of the two most significant digits from 0 to 1, a perfect optimal value 
could still be achieved. Also to bear in mind, is the very limited size of the population 
used in this example. 


Example 10.6 
The block diagram for an angular positional control system is shown in Figure 10.36. 
The system parameters are: 


Amplifier gain K, = 3.5 

Servomotor constant K3 = 15 Nm/A 

Field resistance Rf = 20 0 

Gear ratio n= 5 

Equivalent moment of inertia of motor and load 7. = 1.3 kgm? 
Sampling time T = 0.05 seconds. 


Using a GA with a population of 10 members, find the values of the controller gain 
K and the tachogenerator constant K4 that maximizes the fitness function 


N—1 
J=100 1 Y ((04kT) — OKT)? T (10.98) 
k=0 


when the system is subjected to a unit step at time kT = 0. Perform the summation 
over a time period of 2 seconds (N = 40). Allow a search space of 0-15 for K¡ and 
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Fig. 10.36 Angular positional control system. 


0-1 for K4. Assume that the solution space has 255 values and that each solution 
can be represented by an eight digit binary string, the first four digits representing 
K¡ and the second four representing Ka. 


Solution 
The plant transfer function is 


(10.99) 


If the state variables are x¡ = Op(1) and x> = Ó0(0) = Xx, then the state equations 
become 

X1 ES 0 1 X1 

JLo 0) 15)+| 002 


and the output equations 
0 _ 1.0 X1 
0 = 0 1 X2 


Inserting values into the state equations 


X 0 lfix 0 
E) - E o Ml iy litose (10.100) 


For a sampling time of 0.05 seconds, the discrete form of equation (10.100) is 


x(k+ 17] [1 0.05] [| x,(xT) 0.0126 
EX + al = E 1 | bo] (0 5048 |Y0e7) (10.101) 


From Figure 10.36 the control law is 
UKT) = KO (KT) — x (KT )) — nKyxa(kT) (10.102) 
where Ó¡(kT) =1.0 for all kT >0. 
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Hence values of Ki and K4 generated by the GA are inserted into equation (10.102) 
and the control u(kT') used to drive the discrete plant equation (10.101). The fitness 
function J is updated at each sampling instant to give an overall value at the end of 
each simulation. For a population of 10 members, 10 simulations are required per 
generation. 

Since the required search space is K¡ 0-15, K4 0—1, the following are examples of 
population membership 


K; Ka 

1111 1111 K¡=15 K4=1 

0011 0111 K¡=3  K4= 7/15 = 0.467 
1001 1100 K¡=9  K4= 12/15 =0.8 


Table 10.4 shows the parent selection for mating from a randomly seeded initial 
population. The random numbers (0-1) from the roulette wheel spins were: 0.145, 
0.422, 0.977, 0.339, 0.607, 0,419, 0.075, 0.027, 0.846, 0.047. 

The fitness of the first generation of offsprings is given in Table 10.5. Further 
breeding produced the sixth generation of offsprings given in Table 10.6. Inspection of 
Table 10.6 reveals that values of K¡ = 15, K4 = 0.333 produces a global maximum of 
J = 1065. Figure 10.37 shows the unit step response of the system in Example 10.6 for 


(a) the maximum of the first generation of offsprings (J = 841) 
(b) the global maximum of the sixth generation of offsprings (J = 1065) 


Use of Schemata (Similarity templates): As the progression through generations of 
solutions takes place, there evolves certain similarities between genes within chromo- 
somes. These similarities can be exploited using a similarity template or schema, that 
sits within a schemata framework. 

A schema employs a don't care symbol **”, so, for example, the sixth generation of 
offsprings in Table 10.6 could have employed the template 


The use of schemata will aid the speed of convergence. 


Table 10.4 Parent selection from initial population for Example 10.6 


Parent K; Ka J p=J/Y' J  Cumulative Roulette 
probability wheel hits 
1011 1001 11 0.600 647 0.157 0.157 4 
0100 1010 4 0.667 233 0.056 0.213 0 
0001 0111 1 0.400 112 0.027 0.240 0 
1001 1010 9 0.667 497 0.122 0.362 1 
1110 0111 14 0.467 923 0.224 0.586 2 
0101 0001 5 0.067 e) 0.092 0.678 1 
1001 1101 9 0.867 18 0.004 0.682 0 
0110 1101 6 0.867 46 0.011 0.693 0 
1101 1010 13 0.667 691 0.168 0.861 1 
0101 0100 5 0.267 573 0.139 1.000 1 
Total 4115 1.000 10 
Mean 411.5 0.100 1 
Maximum 923 0.224 4 
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Table 10.5 Fitness of first generation of offsprings for Example 10.6 


Parent Offspring K; Ka J 
10111 1001 101100111 10 0.467 712 
1110 0111 11111 1001 15 0.600 841 
0101 Do 0101 lol 5 0.267 573 
0101 0100 0101 0001 5 0.067 375 
1011|1001 1011/1010 11 0.667 596 
1001/1010 1001/1001 9 0.600 541 
1101 be 1101 0 13 0.600 747 
1011 1001 1011 1010 11 0.667 596 
10111 1001 101100111 10 0.467 713 
1110 0111 11111 1001 15 0.600 841 
Total 6535 
Mean 653.5 
Maximum 841 


Table 10.6 Fitness of sixth generation of offsprings for Example 10.6 


Offspring Ki Ka J 
1110 0101 14 0.333 1030 
1111 0110 15 0.400 1029 
1110 0100 14 0.267 1021 
1111 0101 15 0.333 1065 
1111 0111 15 0.467 970 
1111 0100 15 0.267 1041 
1110 1000 14 0.533 858 
1110 0111 14 0.467 923 
1111 1000 IS 0.533 905 
1111 0101 15 0.333 1065 
Total 9907 
Mean 990.7 


Maximum 1065 


Sixth generation 


First generation 


0.4 


0.2 


0 0.1 0.2 0.3 04 05 0.6 0.7 0.8 0.9 1 
Time (s) 


Fig. 10.37 Comparison between best first generation and best sixth generations solutions for Example 10.6. 
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Other applications of Genetic Algorithms 

(a) Optimal control: Optimal control problems such as the linear quadratic regulator 
discussed in section 9.2 can also be solved using GAs. The discrete quadratic 
performance index given in equation (9.28) can be employed as a (minimum) 
fitness function directly. Alternatively, as shown in Example 10.6 the reciprocal 
of equation (9.28) provides a (maximum) fitness function. 

(b) Self-Organizing Fuzzy Logic Control: Genetic Algorithms may be used to adapt 
both membership functions and rulebase structures in a SOFLC system. 


Figure 10.38 shows an input window with three triangular fuzzy sets NB, Z and 
PB. Each set is positioned in its regime of operation by the centre parameter c so that, 
for example, NB can only operate on the negative side of the universe of discourse. 
The width of each set is controlled by parameter w. 

The chromosome string could take the form 


[c1 w] cz wa C3 w3] (10.103) 
Ca 
C; C3 » 
p 
1.0+ 
NB Z PB 
u 
W: W: 
< ! >< E » 
. E » 


Fig. 10.38 Adaption of membership function features using genetic algorithms. 


If each parameter is a 4-bit string, the configuration in Figure 10.38 would be 


represented by 
[100011111000111110001111] (10.104) 


10.4.3. Alternative search strategies 


In addition to evolutionary search strategies such as GAs, there are a number of 
other search techniques that are employed for design optimization. 
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Simulated annealing 
The physical annealing process consists of heating a metal up to a prescribed 
temperature and then allowing it to cool slowly. During cooling, the molecules form 
crystals which are in a minimum energy condition. The metal, therefore, settles to 
a global minimum energy state. 

With simulated annealing, an energy term E is defined, which then becomes the 
performance index to be minimized. For a given energy change A£ at temperature T, 
the probability P of accepting a solution is 


P=e 2x7 (10.105) 


where k is the Boltzmann constant. Ifthe energy of the system has decreased, then the 
system may move to the new state, based on the probability given by equation 
(10.105). As cooling proceeds along a prescribed schedule, the system avoids local 
minima, and settles down to a global minimum energy state. 


Tabu search 

Like simulated annealing, tabu search is a technique designed to avoid the problem 
of becoming trapped in local optima. The procedure is basically hill-climbing, which 
commences at an initial solution and searches the neighbourhood for a better solu- 
tion. However, the process will recognize, and avoid areas of the solution space that 
1t has already encountered, thus making these areas “tabu”. The tabu moves are kept 
in a finite list, which is updated as the search proceeds. 


10.5 Further problems 


Example 10.7 

A fuzzy logic controller has input and output fuzzy windows as shown in Figure 
10.39. The fuzzy rulebase is given in Figure 10.40. If defuzzification is by the centre of 
area method, calculate crisp control signals u(t) when the error e(t) and the rate of 
change of error ce(+) have the following values: 


e(t) ce(t) [Answer u(t)] 


e 0 => 6.67 
fi) 4-1 2.66 
(iii) 1 15 3.01 
iv) 4-15 0.106 


Note: For the centre of area method, use only those values inside the dotted lines in 
the output window. 


Example 10.8 

The angular positional control system shown by the block diagram in Figure 10.36 1s 
to have the velocity feedback loop removed and controller K replaced by a fuzzy 
logic controller (FLC) as demonstrated by Barrett (1992). The inputs to the FLC 
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le) (ce) 
10+ 1.0 
0.8+ 0.8+ 
0.6+ 0.6 + 
NB PB 
0.4+ 0.4+ 
0.2+ 02 
5) 0 5 e 2 
Input Windows 
é (a) 
H(u) 
LO =+ 
0.8+7— 
0.6+7 
0.4+ 
0.2+ 
-10 0 10 u 
Output Window 
á (0) 
Fig. 10.39 Input and output fuzzy windows for Example 10.7. 
e 
NB Z PB 
ce 
NB NB NB Z 
Z NB £ PB 
PB Z PB PB 


Fig. 10.40 Fuzzy rulebase for Example 10.7. 


are angular error e(kT) and rate-of-change of angular error ce(kT'). The output from 
the FLC is a control signal u(kT). The input and output fuzzy windows have the 
same number of fuzzy sets, but different scales for the universes of discourse as 
shown in Figure 10.41. The fuzzy rulebase is given in Figure 10.42. If the state 


variables are 


x1 = Oo(t) 


Xy = Ó0t0) = Xi 
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NB NM NS ZE PS PM PB 
1.0 
4 3 2 1 0 1 2 3 4 
Normalized Universe of Discourse 
| | | | 
=3 —2 -1 0 1 2 3  e(kT) 
| | | | | | 
8 6 4 2 0 2 4 6 8  ce(kT) 
| | | | | | | | | 
5 4 3 2 1 0 1 2 3 4 5 Uu(kT) 


Fig. 10.41 Input and output fuzzy windows for Example 10.8. 


NB NB NB NM NS ZE PM PB 
NM NB NB NM NM PS PM PB 
NS NM NS NS NS PS PM PM 
ZE NM NS NS ZE PS PS PM 
PS NM NM NS PS PS PS PM 
PM NB NM NS PM PM PB PB 
PB NB NM ZE PS PM PB PB 


Fig. 10.42 Fuzzy rulebase for Example 10.8. 
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then the state and output equations for the plant are as given in equation (10.100) 
X1 0 1 X1 0 
= + u 
X2 0.0 X2 10.096 
01 1.0 X1 
0, E 0 1 X2 
and, for a sampling time of 0.2 seconds, the discrete form of equation (10.106) is 


m(+ 17] _ [1 02][x1(*7)] , [0.2019 
Eon NE lo 1 | o sE ono) | 0er) (10.107) 


(10.106) 


If the system, which is initially at rest when k7' = 0, is given a unit step input at this 
time, determine ekT), cAkT), u«(kT), xi(kT) and x2(kT) for values of kT =0, 
0.2, 0.4 and 0.6 seconds. 


Assume that 
e(kT) = (6; — 00) =1—x1(kT) 
ce(kT) = d/d1(0; — 00) 
_d6 di 


de dí 


do 
=0- q = a (KT) 


Solution 


Table 10.7 Solution to Example 10.8 


KT xu(kT)  x2AkT) e(kT) ce(kT) UKT) x(k+DT  x(k+1T 


0 0 0 1 0 1.083 0.2187 2.187 
0.2 0.2187 2.187 0.7813 2.187 0.666 0.7906 3.532 
0.4 0.7906 3.332 0.2094 3.532  —1.32 1.2305 0.867 


0.6 1.2305 0.867 0.2305 0.867 0.511 1.3007 0.165 


Example 10.9 

A neural network has a structure as shown in Figure 10.43. Assuming that all 
the activation functions are sigmoids, calculate the values of y¡2 and y, when the 
inputs are 


(a) Xx] = 0.3, X= 0.5 
(b) x, =0.9, x,=0.1 


when the weights and biases are 
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Output layer 
((=2) 


Hidden layer 
((=1) 


Input layer 
(1=0) 


Fig. 10.43 Neural network structure for Example 10.9. 


Hidden layer 


pa 2 
Wi=13 3| bi=|-2 
21 1 


Output layer 


Solution 
(a) Yi = 0.450, Ya = 0.862 
(b) y12 = 0.405, y2 = 0.906 


Example 10.10 

In Example 10.9(b), if the target values for the outputs are di =0 and da» =1, 
calculate new values for the weights and biases using the back-propagation algo- 
rithm. Assume a learning rate of 0.5 with no momentum term. 
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Solution 
Output layer: 4, = —0.098, $, = 0.008 (Equation 10.78) 


ww, [-3.047 2.036 0954] , _ [2951 
PR 1004 2.003 3.004| “?— |-2.0996 


Hidden layer: $, = 0.0016, 6, = 0.042, 63 = —0.003 (Equation 10.80) 


1.0007 2.00008 2.0008 
W;= | 3.019 3.0021 | bj = |-1.979 


1.999 0.9999 


Example 10.11 
A system has a parabolic fitness function 


J=-x+2x (10.108) 


Using a genetic algorithm, find the value of x that maximizes J in equation (10.108). 
Assume that the solution space has 31 values in the range x = 0 to 2 and that each 
solution can be represented by a five digit binary string ranging from 00000 to 11111. 
Let the population have four members and it is initially seeded by spinning a coin 
(heads = 1, tails = 0). 


Solution 

x(2) 01110 01111 10000 10001 
x(10) 14 15 16 17 

Xx 0.903 0.968 1.032 1.097 

J 0.990591 0.998976 0.998976 0.990591 


Hence x = 0.968 and 1.032 both give optimum solutions. 


Example 10.12 

The closed-loop control system analysed by the root-locus method in Example 5.8 
can be represented by the block diagram shown in Figure 10.44. Using root-locus, the 
best setting for K¡ was found to be 11.35, representing a damping ratio of 0.5. 


Proportional Plant 
Controller 


Rís) + El U C 
(s) (s) K (s) == DES (s) 


Fig. 10.44 Block diagram for Example 5.8. 
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Validate, or otherwise, using a genetic algorithm that this value of K¡ maximizes 
the fitness function 


N-1 
J= 100 / Y (HkT) — AkT)?T) (10.109) 
k=0 


when the system is subjected to a unit step at time k7' = 0. Using a sampling time 
T =0.05 seconds, perform the summation over a time period of 10 seconds 
(NV = 200). Allow a search space of 0-100 for K¡. Assume that the solution space 
has 255 values and that each solution can be represented by an eight digit binary 
string chromosome. Use a randomly seeded initial population of 10 members. 
If the state variables are 

x1 =C(t) 

x= c(t) =X1 

Xx3 = C(1) = X2 
From Figure 10.44, the plant differential equation may be written as 

X3 = 0x1 = 10x> = 7x3 +u 


The plant state and output equations are then 


X1 0 1 0 X1 0 
x|=|0 0 1 x|+J|0Jfu 
X3 0 -10 —7||x33 1 
C=[1 0 0lx (10.110) 
For a sampling time of 0.05 seconds, the discrete form of equation (10.110) is 
xr(k+ DT 1.0 0.0498 0.0011 | | xi(kT) 0.00002 
xl(k+1)T | =|0.0 0.9889 0.0420 | | xA(kT) | + | 0.00111 | u(xT) 
x3(k + 1T 0.0 —0.4201 0.6948 | | xx(kT') 0.04201 
(10.111) 
Solution 


K1(2) 00011101 00101001 00110011 00111000 10000001 10110011 


K¡(10) 29 41 51 56 129 179 
Ki 11.37 16.08 20.0 21.96 50.59 70.20 


J 112.99 124.51 126.63 125.82 48.18 7.77 


Thus the value of K¡ that maximizes the fitness function in equation (10.109) is 
K¡ = 20.0. This produces an overshoot of 38% when kT = 2.0 seconds, and repre- 
sents an wy Of 1.847 rad/s and a € of 0.303. 


Appendix 1 
Control system design 
using MATLAB 


A1.1 Introduction 


MATLAB, its Toolboxes and SIMULINK have become, over a number of years, the 
industry standard software package for control system design. The purpose of this 
Appendix is to introduce the reader to some of the more useful aspects of MATLAB, 
and to illustrate how the software may be used to solve examples given in the main 
text of the book. 


A1.1.1 Getting started 


The examples given in this Appendix were generated using MATLAB Version 5.3. 
Once the software has been installed, MATLAB is most easily entered by clicking the 
MATLAB icon. Alternatively, in a Windows environment, MATLAB can be entered 
by clicking the following sequence 


Start —> Programs —» MATLAB for Windows —» MATLAB 5.3 


The user should now be in the MATLAB command window, which contains some 
helpful comments together with the MATLAB prompt ». MATLAB commands are 
typed after the prompt, and entered using “Return” (or “Enter”). Terminating the 
command with %” will suppress the result of the command being printed in the 
command window. Comments are preceded by the “%” symbol. 


A1.2 Tutorial 1: Matrix operations 


This tutorial introduces the reader to matrix operations using MATLAB. All text in 
courier font is either typed into, or printed into the command window. 


»% Matrix Operations 
»% To enter a matrix 
»A=[1 3;5 9]; 

»B=[4 -7;10 O]; 

»A 
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A= 
1 3 
5 9 

» B 

B= 
4 1 
10 0 


»% Note that MATLAB is case sensitive 
»% Matrix Addition 
»A+B % Terminating with *;* will suppress “ans” 


ans= 
5 -4 
15 9 
»% Matrix Multiplication 
» AFB 
ans= 
34 =1 
110 -35 
»% Determinant of a Matrix 
»det(A) 
ans= 
=6 
»% Inverse of a Matrix 
»inv(A) 
ans= 


-1.5000 0.5000 

0.8333 -0.1667 
»% Check 
»C=inv(A); 
» AFC 
ans= 

1.0000 0.0000 

0.0000 1.0000 
»% Solve A”—-1*B 
»ANB 
ans= 

-1.0000 10.5000 

1.6667 -5.8333 

»% Solve A*B--1 
»A/B 
ans= 

0.4286 0.2714 

-1.2857 1.0143 
»% Eigenvalues of a Matrix 
»elg(A) 
ans= 

0.5678 

10.5678 
»% Coefficients of Characteristic Equation (as"2+bs+c) 
»poly(A) 
ans= 

1.0000 -10.0000 -6.0000 
»% Roots of Characteristic Equation (as"2+bs+c=0) 
»ce=[1 -10 -6]; 
»roots(ce) 
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ans= 
10.5678 
-0.5678 
»% Note that roots(ce) and eig(A) give the same result 
»% Transpose of a Matrix 
yA” 
ans= 
1.5 
3, +9 
»% Rank of a Matrix 
»rank(A) 
ans= 
2 
»% Create an Identity Matrix 
»I=eye(3); 
»E 
T= 
100 
01.0 
o.0o 1 
»% Condition of a Matrix 
»% The higher the Condition Number, the more ill1-conditioned the 
»% matrix is 
»% Log10 of Condition Number gives approx. number of decimal 
»% places 
»% lost due to round-off errors 
»cond(A) 
ans= 
19.2815 
»% Tutorial End 


The above session may be printed by clicking 
File —> Print 

MATLAB may be closed by clicking 
File —> Exit MATLAB 


A1.3 Tutorial 2: Time domain analysis 
This tutorial introduces the reader to time domain analysis using MATLAB. It uses 
commands from the Control System Toolbox. A list ofthe commands can be found using 
»help control 


More information on individual commands can be obtained, for example 


»help step 
will provide more detail on how to use the step command. 


Script files: A script file is an ASCII text file of MATLAB commands, that can be 
created using 
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(a) a text editor 
(b) the MATLAB editor/debugger 
(c) a word processor that can save as pure ASCII text files. 


A script file should have a name that ends in *.m”, and is run by typing the name of 
the file (without *.m”) after the MATLAB prompt, or by typing the sequence 


File —> Run Script —» enter file name 


The advantage of a script file is that 1t only needs to be created once and saves the 
labour of continually typing lists of commands at the MATLAB prompt. 

The examples given in this tutorial relate to those solved in Chapter 3. Consider 
a first-order transfer function 


G(s)=1/1+s 


The impulse response function (Example 3.4, Figure 3.11) can be created by the 
following script file 


File name: examp34.m 


“impulse response of transfer function G(s)=num(s)/den(s) 
“num and den contain polynomial coefficients 

“in descending powers of s 

clf 

num=[1]; 

den=[1 1]; 

impulse (num,den); 

grid; 

printsys(num,den,'*s'); 


This shows how a transfer function is entered into MATLAB, where num =[1] is the 
numerator (K = 1) and den=[1 1] represents the “s” coefficient and the “s” 
coefficient respectively. * Impulse (num, den) computes and plots the impulse 
response and grid produces a rectangular grid on the plot. Printsys (num, 
den, *s”) prints the transfer function at the MATLAB prompt. A hard copy 
can be obtained by selecting, from the screen plot 


File —> Print 


The step response of a first-order system (Example 3.5, Figure 3.13) is obtained using 
the step command 


File name: examp35.m 


% step response of transfer function G(s)=num(s)/den(s) 
“num and den contain polynomial coefficients 
“in descending powers of s 


clf 

num=[1]; 
den=[1 1]; 
step(num,den); 
grid; 


printsys(num,den,'*s'); 
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SIMULINK: The Control System Toolbox does not possess a “ramp” command, but 
the ramp response of a first-order system (Example 3.6, Figure 3.15) can be obtained 
using SIMULINK, which is an easy to use Graphical User Interface (GUD. SIMU- 
LINK allows a block diagram representation of a control system to be constructed 
and real-time simulations performed. 

With MATLAB Version 5.3, typing simulink at the MATLAB prompt brings 
up the SIMULINK Library Browser. Clicking on the “Create new model” icon in the 
top left-hand corner creates a new window called “untitled”. 

Clicking on the [EH] icon attached to SIMULINK lists the SIMULINK options, 
and E] Continuous lists the continuous systems options. To obtain a transfer func- 
tion block, click and hold left mouse button on the “Transfer Fen” icon under 
“Continuous”, and drag to “untitled” window. 

Click on [to close down “Continuous” and click on E] “Sources” to drag “Ramp” 
from Browser to “untitled? window. Close down “Sources” and click on E] "Sinks” to 
drag “Scope” to “untitled”. Holding down left mouse button connect “Ramp”, 'Trans- 
fer Fcn” and “Scope” together as shown in Figure Al.1. 

Double click on “Scope” to bring up scope screen, and, in “untitled”, click “Simula- 
tion” and “Start”. The ramp response should appear on the scope screen. Click on the 
scope screen and choose autoscale (binoculars). Click print icon to obtain a hard 
copy of the ramp response. In the “untitled” window, click on *File” and “Save As” 
and save as a “.mdl' (model) file in a directory of your choice (i.e. examp36.mdl in 
“work”). 

The transfer function for a second-order system can easily be obtained in terms of 
wn and € using the ord2 command. This has w, and (€ as input arguments and 
generates the numerator and denominator of the equivalent transfer function. The 
script file sec_ord.m shows how Figure 3.19 can be generated using the ord2 and 
step MATLAB commands 


File name: sec_ord.m 


“Second-order system 
t=[0:0.1:15]; 

wn=1; 

zeta=0.2; 

num, den]=o0rd2(wn,zeta) 
y,X,t]=step(num,den,t) 
zeta=0.4; 
numl,den1]=0rd2 (wn,zeta); 
y1,x,t]=step(numl,den1,t); 
zeta=0.6; 

num2,den2]=0rd2 (wn,zeta); 
y2,X,t]=step(num2,den2,t); 
plot (t,y,t,y1,t,y2); 

grid; 


, 
r 


In sec_ord.m a user supplied common time base (+= 0-15 seconds in 0.1 second 
intervals) has been set up. The p1ot command superimposes the step responses for 
zeta = 0.2, 0.4 and 0.6. 

The step response for Example 3.8, the resistance thermometer and valve, shown in 
Figure 3.23 can be generated with script file examp38.m. 


Appendix 1 Control system design using MATLAB 


ZA 


Ramp Transfer Fen Scope 


Fig. A1.1 SIMULINK model for the ramp response of a first-order system. 


File name: examp38.m 


%Step response of a third-order system 

%G(s)=12.5/(s+0.5) (s"24+85+25) 

clf 

num=[12.5]; 

den=conv([1 05],[1 1 25]); 

step (num,den); 

grid; 

The transfer function is based on equation (3.75), with the input term X¡(s) = 1/s 
removed. The denominator is input using the conv command (short for convolu- 
tion), which multiplies two polynomial expressions together. 


A1.4 Tutorial 3: Closed-loop control systems 


This tutorial shows how MATLAB can be used to build up and test closed-loop 
control systems. The examples given relate to those solved in Chapter 4. The com- 
mands used in MATLAB to create a single model from the elements in the control 
loop are 


Command Operation 


series Combines blocks in cascade, see Transformation 1, Table 4.1 
parallel  Combines blocks in parallel, see Transformation 2, Table 4.1 
feedback  Eliminates a feedback loop, see Transformation 4, Table 4.1 
cloop Closes the loop with unity feedback. 


Example 4.5 is a PI controlled liquid-level system shown in Figure 4.26. In the block 
diagram representation, Figure 4.27, the system parameters are 

Ki=1; T¡=5 seconds; K,= 0.1m*/sV 

Rp=159m% 4A=2m% Hi=l 
The PI controller and control valve transfer function is therefore 


0.55 +0.1 


ia Ss 


and the plant transfer function is 


15 


Co 1 
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Since A¡ = 1, the system has unity feedback, and the closed-loop transfer function 
and step response is given by 


Filename: examp43.m 


“Example 4.5 (Liquid-Level Process Control System) 
“Use of series and cloop 
numc=[ 0.5 0.1]; 


denc=[5 0]; 
nump=[15]; 
denp=[30 11; 


[numo1l ,denol]=series(numc,denc,nump,denp); 
[numc1,dencl1]=c1o0oop(numo1l,denol); 
printsys(numcl,dencl1,*s'); 

step (numcl,dencl1); 

grid; 


Case study Example 4.6.1 15 a CNC machine-tool positional control system, whose 
block diagram representation is shown in Figure 4.31. When system parameter values 
are inserted, the block diagram is as shown in Figure A1.2. 

The closed-loop transfer function and step response is given by 


Filename: examp461.m 


“Case Study Example 4.6.1 (CNC Machine-Tool Positional Control) 
“Use of series and feedback 

nump=[80]; 

denp=[0.45 01; 

nump1=[0.365]; 


denp1=[1 01]; 
numvf=[0.697]; 
denvf=[1]; 
numpf=[60]; 
denpf=[11; 


[num,den]=feedback (nump ,denp,numvf ,denvf); 
[numfp denfp]=series(num,den,numpl1,denpl); 
[numc1,dencl1]=feedback (numfp, denfp,numpf denpf); 
printsys(numcl,dencl,*s'); 

step(numcl,dencl1); 

grid; 


In this example, the inner loop is solved first using feedback. The controller and 
integrator are cascaded together (nump1,denp1) and then series is used to 
find the forward-path transfer function (numfp,denfp). Feedback is then 
used again to obtain the closed-loop transfer function. 

The time response of the CNC control system is also obtained using SIMULINK 
as shown in Figure A1.3. Note that the variables £ and xy have been sent to work- 
space, an area of memory that holds and saves variables. The commands who and 
whos lists the variables in the workspace. The system time response can be obtained 
by the command 


plot (t,Xo) 
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Amplifier, Motor 
Controller and Machine Table Integrator 


Xo(S) 


Xa(s) + + 80 
Se 0.365 do > 1. ——> 
Ea . Ss 


0.697 
Tachogenerator 
60 ¡4 


Position Transducer 


Fig. A1.2 CNC machine-tool positional control system. 
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0.69) 


Tachogenerator 


Position 
Transducer 


Fig. A1.3 SIMULINK simulation of CNC machine-tool positional control system. 


Case study Example 4.6.2 is a PID temperature control system, and is represented by 
the block diagram in Figure 4.33. Here, the PID control transfer function is not 
“proper”, and the series command does not work. The forward path transfer 
function, with values inserted, is 


29.4125? + 39.216s + 13.072 
3s(4s + 11(8s + 1) 


Gip(s) = 


The closed-loop transfer function and step response is given by 


Filename: examp462.m 


“Case study example 4.6.2 (Temperature Control) 
Use of feedback 
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numfp=[ 29.412 39.216 13.072]; 

denfp=conv([3 0], conví([4 1]1,[18 1])); 

numtf£=[1]; 

dentf=[1]; 

[numc1 ,dencl1]=feedback(numfp,denfp,numtf dentf); 
printsys(numcl,dencl1,*s'); 

step(numcl,dencl1); 

grid; 

Case study Example 4.6.3 is a ship autopilot control system. The block diagram 
representation is given by Figure 4.37. Inserting system parameters gives a forward- 
path transfer function 


0.2 
205? + 25 


The closed-loop transfer function and step response is given by 


Gipls) = 


Filename: examp463.m 


+Case study example 4.6.3 (Ship Autopilot Control System) 
“Use of feedback 


numfp=[0.2]; 
denfp=[20 2 01; 
numhf=[1]; 
denhf=[1]; 


[numc1 ,dencl1]=feedback (numfp,denfp,numhf denhf); 
printsys(numcl,dencl1,*s'); 

step(numcl,dencl1); 

grid; 


A1.5 Tutorial 4: Classical design in the s-plane 


The tutorial demonstrates how MATLAB is used to generate root locus diagrams, 
and hence how to design control systems in the s-plane. Examples given in Chapter 5 
are used to illustrate the MATLAB commands. The roots of the characteristic 
equation (or any polynomial) can be found using the roots command. 


Example 5.1 
Check the stability of the system that has the characteristic equation 


4274 3 +45+2=0 


At the MATLAB prompt type 


»ce=[1 2 1 4 21; 
»rootsí(ce) 

ans= 

-2.1877 
0.35164+1.2843i 
0.3516-1.28431 
0.5156 


Two roots have positive real parts, hence the system is unstable. 
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Example 5.2 
What values of K¡ make the following system unstable 
8K 
(SN H(S) = >=. 
JS s(s2 + s +2) 


Filename: examp352.m 


“Roots of denominator of closed-loop transfer function 
k1=0.25 

num=[8*k1]1; 

den=conv([1 0],[1 1 2]); 

[numc1 ,denc1]=clo0o0p (num, den); 

roots(dencl) 


Running examp32.m with K; set to 0.25, 0.15 and 0.35 gives 


»examp52 
k1= 


ans= 


0.00004+1.4142i 
0.0000-1.4142i 
-1.0000 


»examp52 


ans= 


-0.16304+1.32431i 
-0.1630-1.32431i 
0.6740 


»examp52 


ans= 


0.11404+1.5057i 
0.1140-1.5057i 
-1.2280 


Hence, with K¡ = 0.15, the system is stable, K¡ = 0.25, the system has marginal 
stability and K; = 0.35, the system is unstable. 


Example 5.8 
The root locus for 


K 


G(sSH(s) = SE 25 +5) 


can be drawn using the r locus command as shown in examp38.m 
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Filename: examp38.m 


“Example 5.8 Simple root locus 
$G(s)=K/s(s+2) (s+5) 

cf 

num=[1]; 

den=convíconví([1 0],[1 2]),[1 5]); 
rlocus(num,den); 

axis([-9 2 -4 4]);5 

“axis(*square'); 


With no axis command, the axes are generated automatically. Alternatively, user 
defined axes can be generated with axis ([Xmin Xmax Ymin Ymax ] ). Using the 
command “square” generates the same scales on both x and y axes. With 
examp38.m it 1s easy to experiment with all three methods. 

Using MATLAB to design a system, it is possible to superimpose lines of constant 
(and w, on the root locus diagram. It is also possible, using a cursor in the graphics 
window, to select a point on the locus, and return values for open-loop gain K and 
closed-loop poles using the command 


[k, poles]J=relocf ind(num, den) 


The script file examp38a.m shows how this is achieved 


Filename: examp38a.m 


“Example 5.8 Root locus 
$G(s)=K/s[s+2)(s+5) 

clf 

num=[1]; 

den=convíconv)[1 0]1,[1 2]),[1 5]); 
rlocus(num,den); 

axis([-9 2 -4 4]); 
zeta=0.5;5 

wn=2:2:8; 

sgrid(zeta,wn); 
[k,poles]=rlocfind(num,den) 


Here a line of € =0.5(6 = 607) is drawn together with four w, circles (w, = 2, 4, 6 
and 8rad/s.) At the MATLAB prompt, the user is asked to select a point in the 
graphics window. If the intersection of the complex locus with the (€ = 0.5 line is 
selected (see Figure 5.14), the following response is obtained 


»examp58a 
Select a point in the graphics window 


selected point= 
-0.71434+1.2541i 


k= 
11.5754 
poles= 
5.5796 


-0.71024+1.2531i 
-0.7102-1.2531i 


Example 5.9 is solved using examp359.m to create Figure 5.16. 
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Filename : examp59.m 


“Example 5.9 Root Locus 
%G(s)=K/s(s"24+4s+13) 


den=conv([1 0],[1 4 13]); 

rlocus(num,den); 

axis[[-9 2 -4 4]);5 

zeta=0.255 

wn=3; 

sgrid(zeta,wn); 

k=rlocf ind (num, den) “Select k from graphic window 


When run, the program invites the user to select a point in the graphics window, which 
may be used to find the value of K when € = 0.25. Ifthe last line of examp59.m is typed 
at the MATLAB prompt, the cursor re-appears, and a further selection can be made, 
in this case to select the value of K for marginal stability. This is demonstrated below 


»examp59 


Select a point in the graphics window 
selected_point= 
-0.74294+2.91751 
k= 
22.9452 
»k=rlocfind(num,den) 
Select a point in the graphics window 
selected_point= 
0+3.63041 
k= 
DL ZZZ 


» 


Example 5.10 uses the root locus method to design a PD controller that will allow the 
system 

1 
sís + 25 + 5) 
To meet a given time-domain specification. In examp310.m, the PD controller takes 
the form 


G(sSH(s) = 


G.(s) = K1(s +2) 


Filename: examp510.m 


“Example 5.10 Root Locus 
%G(s)=K(s+2)/s(s+2) (s+5) 

clf 

num=[ 1 2]; 

den=convíconví([1 0],[1 21),[1 5]);5 
rlocus(num,den); 

axis([-9 2 -4 4]); 

zeta=0.7; 

wn=3.5; 

sgrid(zeta,wn); 

k=rlocfind(num,den) $Select k from screen 
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num=[k k*2]; 
[numc1,denc1]=clo0o0p (num, den); 
step(numcl,dencl1); 

grid; 


This produces the (pole-zero cancellation) root locus plot shown in Figure 5.18. 
When run, examp510.m allows the user to select the value of K that corresponds 
to (= 0.7, and then uses this selected value to plot the step response. The text that 
appears in the command window is 


»examp510 
Select a point in the graphics window 
selected_point= 
-2.48574+2.52151 
k= 
12.6077 


» 


Case study Example 5.11 uses root locus to design a ship roll stabilization system. 
The script file examp5ll.m considers a combined PD and PID (PIDD) controller of 
the form 


2 
ne Ki(s+ Je + 4s +8) 


Filename: examp311.m 


“Example 5.11 Root Locus 

$G(s)=K(s+2) (sr24+4s4+8)/s(s+1) (sr240.784+2) 
clf 

num=conv([1 2],[1 4 81); 
den=convíconví([1 0],[1 1]1),[1 0.7 2]); 
rlocus(num,den); 

axis[([-9 2 -4 4]); 

zeta=0.7; 

wn=4.2; 

sgrid(zeta,wn); 

k=rlocfind(num,den) % Select k fromscreen 
num=k*conv([1 2]1,[1 4 81); 
[numc1,denc1]=clo00p (num, den); 
step(numcl,dencl1); 

grid; 


This script file produces the root locus shown in Figure 5.24 and allows the user to 
select the value of K furthest from the imaginary axis that corresponds to ( = 0.7. 
The command window text is 


»examp511 
Select a point in the graphics window 
selected_point= 
-3.2000+3.2607i 
k= 
10.2416 


» 


When K has been selected, the roll angle step response, as shown in Figure 5.25 is 
plotted. 
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A1.6 Tutorial 5: Classical design in the frequency 
domain 


This tutorial shows how MATLAB can be used to construct all the classical fre- 
quency domain plots, 1.e. Bode gain and phase diagrams, Nyquist diagrams and 
Nichols charts. Control system design problems from Chapter 6 are used as examples. 


Example 6.1 
Construct the Bode diagram for 


Filename: examp61.m 


Jo 


Example 6.1 Bode Diagram 
%First-order system 
num=[2]; 

den=[0.5 1]; 
bode(num,den); 


The Nyquist diagram for the same system is 


Filename: examp6 la.m 


“Example 6.1(a) Nyquist Diagram 
%*First-order system 

num=[2]; 

den=[0.5 1]; 

nyquist (num,den); 


The script file exampó6 1b.m shows how it is possible to customize a Bode diagram 


Filename: examp61b.m 


“Example 6.1(b) 
“Customizing a Bode Diagram 


e 
num=[2]; 
den=[0.5 1]; 


w=logspace(-1,2,200);%w from 10"-1 to 102,200 points 
[mag ,phase,w]=bode (num, den,w) % cal mag and phase 
semilogx (w,20*l1og10(mag)), grid; 

xlabel(*Frequency (rad/s)'), ylabel(“*Gain dB'); 


The logspace command allows a vector of frequencies to be specified by the 
user, in this case, 200 points between 107! and 10? (rad/s). The bode command has a 
left-hand argument [mag phase ,w] which allows the magnitude and phase to be 
calculated, but not displayed. The semilogx command plots the magnitude (con- 
verted to deciBels) against log frequency, and gr id provides a log-linear grid. Script 
file examp62.m produces a second-order Bode gain diagram for Example 6.2. 
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Filename: examp62.m 


“Example 6.2 Bode Diagram 

“Second-order system 

ELE 

num=[4]; 

den=[0.25 0.2 1]; 

w=logspace(-1,2,200); 
[mag,phase,w]=bode (num, den,w) ; 
semilogx(w,20*1o0og10(mag)),grid; 
xlabel(*Frequency (rad/s)'), ylabel (“Gain dB') 


The Nyquist diagram (w varying from —oo to +00) is produced by examp64.m 
where 


K 


G(SH(s) = (+ 25+4) 


Filename: examp64.m 


“Example 6.4 Nyquist Diagram 
+Third-order type one system 
num=[1]; 

den=conví([1 0],[1 2 4]); 
nyquist (num,den); 
axis([-0.6 0.1 -0.6 0.1]); 


Note that to obtain a reasonable diagram, it is usually necessary for the user to define the 
scales of the x and y axes using the axis command. The script file exampó64a.m produces 
the Bode gain diagrams for the same system when K = 4 and 8, see Figure 6.23(a). 


Filename: examp64a.m 


“Example 6.4(a) 

G(s)=K/s(s"24+2s4+4) 

“Creates Bode Gain Diagrams for K=4 and 8 
clf 

num=[4]; 

den=conví([1 0],[1 2 4]); 
w=logspace(-1,1,200); 
mag,phase,w]=bode(num,den,w); 
semilogx(w,20*1o0g10(mag)); 

num=[8]; 
[mag1,phase1l,w]=bode (num, den,w); 
semilogx(w,20*1o0g10(mag),w,20*10g10(mag1)) grid; 
xlabel('*Frequency (rad/s)') ylabel (*Gain (dB)') 


Using the command margin (mag, phase ,w) gives 


(a) Bode gain and phase diagrams showing, as a vertical line, the gain and phase 
margins. 

(b) a print-out above the plots of the gain and phase margins, and their respective 
frequencies. 


This is illustrated by running examp64b.m, which confirms the values given in Figure 
6.23, when K = 4. 
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Filename: examp64b.m 


Example 6.4(b) 
G(s)=K/s(s2425+4) 

Creates a Bode Gain and Phase Diagrams for K=4 
Determines Gain and Phase Margins 
clf 

num=[4]; 

den=conv([1 0],[1 2 4]); 
w=logspace(-1,1,200); 

[mag ,phase,w]=bode (num, den,w); 
margin(mag,phase,w); 
xlabel(*Frequency(rad/s)'); 


0 JN y y 


Script file fig627.m produces the Nichols chart for Example 6.4 when K= 4, as 
illustrated in Figure 6.27. The command ngrid produces the closed-loop magni- 
tude and phase contours and axis provides user-defined axes. Some versions of 
MATLAB appear to have problems with the nichol1s command. 


Filename: fi2627.m 


“Example 6.4 as displayed in Figure 6.27 
%G(s)=K/s(s.2+2s5+4) where K=4 

Nichols Chart 

num=[4]; 
den=conv([1 0],[1 2 41); 
nichols(num,den); 

ngrid; 

axis([-210 O -30 401); 


Running script file fig629.m will produce the closed-loop frequency response gain 
diagrams shown in Figure 6.29 for Example 6.4 when K = 3.8 and 3.2 (value of K 
for best flatband response). 


Filename: fig629.m 


“Example 6.4 as displayed in Figure 6.29 
%G(s)=K/s(s2+28+4) 

“Creates closed-loop Bode Gain Diagrams for K=3.8 and 3.2 
“Prints in Command Window Mp,k,wp and bandwidth 

clf 

num=[3.8]; 

den=conv([1 0],[1 2 4]); 

w=logspace(-1,1,200); 

[numc1 ,denc1]=clo0o0p(num,den); 

[mag ,phase,w]=bode(numc1l,dencl1,w); 

[Mp ,k]=max(20*10g10(mag)) 

wp=w(k) 

n=1; 

while 20*10g10(mag(n))>=-3,n=n+1; end 

bandwidth=w(n) 

num=[3.2]; 

[num2c1,den2c1]=c1lo0o0p (num, den); 
[mag1,phasel,w]=bode(num2c1,den2c1,w); 
semilogx(w,20*10g10(mag),w,20*10g10(magl1)), grid; 
xlabel(*Frequency (rad/s)') ylabel (*Gain)dB)') 
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The command clo0p is used to find the closed-loop transfer function. The com- 
mand max is used to find the maximum value of 20 log¡p (mag), i.e. My and the 
frequency at which it occurs ¡.e. w, = w(k). A while loop is used to find the —3dB 
point and hence bandwidth=w(n). Thus, in addition to plotting the closed-loop 
frequency response gain diagrams, fig629.m will print in the command window: 
» 
Mp= 

3.1124 
k= 

121 
wp= 

1.6071 
bandwidth= 

Z 1711 


Case study 
Example 6.6 


This is a laser guided missile with dynamics 


G(s)H(s) = ss E5) 


The missile is to have a series compensator (design one) of the form 
K(1+s5) 
(1 + 0.255) 


Figure 6.34 is generated using fig634.m and shows the Nichols Chart for the uncom- 
pensated system. Curve (a) is when the compensator gain K = l, and curve (b) is 
when K = 0.537 (a gain reduction of 5.4 dB). 


G(s) = 


Filename: fig634.m 


“Nichols Chart for Case Study Example 6.6 
“Lead Compensator Design One, Figure 6.34 
clf 

“Uncompensated System 

num=[20]; 

den=[1 5 O 01; 

w=logspace(-1,1,200); 
mag,phase,w]=nichols(num,den,w); 
“Compensator Gain set to unity 

numl=[20 20]; 

denl=conv([0.25 1],[1 5 O 0]1); 
magl1l,phase1l,w]=nichols(num1l,den1,w); 
“Compensator Gain reduced by 5.4dB 
num2=[ 10.74 10.74]; 

den2=conv([0.25 1],[1 5 O 0]); 
mag2,phase2,w]=nichols(num2,den2,w); 
plot (phase,20*1o0g10(mag) phasel1,20*1lo0g10(magl), 
phase2,20*1lo0g10(mag2)) 

ngrid; 

axis([-240 -60 -20 301); 
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A1.7 Tutorial 6: Digital control system design 


This tutorial looks at the application of MATLAB to digital control system design, 
using the problems in Chapter 7 as design examples. 


Example 7.3 
To obtain the z-transform of a first-order sampled data system in cascade with 
a zero-order hold (zoh), as shown in Figure 7.10. 


Filename: examp73.m 


Jo 


Example 7.3 Transfer Function to z-Transform 
“Continuous and Discrete Step Response 


num=[ 1]; 
den=[1 1]; 
Ts=0.5; 


[numd ,dend]=c2dm(num,den,Ts,'zoh'); 
printsys(num,den,'*s') 
printsys(numd,dend,*z') 
subplot(121), step(num,den); 
subplot (122), dstep(numd,dend); 


The continuous to discrete command c2dm employs a number of conversion meth- 
ods in the last term of the right-hand argument. These include 


“zoh' zero-order hold 
“foh' first-order hold 
“*tustin”  tustin's rule (see equation 7.102) 


The command subplot (mnp) creates an m-by-n array of equal sized graphs, the 
argument p indicates the current graph. Thus subplot (12p) produces a single row, 
two column array (1.e. side by side graphs). When p= 1, the left-hand graph is 
produced and when p=2, the right-hand one is produced. Running examp73.m 
generates step response plots of both continuous and discrete systems, with the 
following text in the command window 


» 
num/den= 
1 


s+1 
num/den= 
0.39347 
z-0.60653 


Example 7.4 
This is a closed-loop digital control system as shown in Figure 7.14, with a plant 
transfer function 


Filename: examp74.m 


Example 7.4 Open and Closed-Loop Pulse Transfer Functions 
Discrete Step Response 


Je y 
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num=[1]; 

den=conv[1 0],[1 21; 

Ts=0.55 

[numa ,dend]=c2dm(num,den,Ts,'zoh'); 
[numc1d,denc1d]=cl1o0o0p (numd,dend); 
printsys(num,den,'*s”') 
printsys(numd,dend,*z”) 
printsys(numcld,dencld,'*z”') 
dstep(numcld,dencld); 


Note that the command cloop works with both continuous and discrete systems. 
Running examp74.m will produce a step response plot of the closed-loop discrete 
system, and the open and closed-loop pulse transfer functions will be written in the 
command window 


» 
num/den= 
1 
s24+2s 
num/den= 
0.09197z+0.06606 
z12-1.3679z+0.36788 
num/den= 
0.09197z+0.06606 
z12-1.275924+0.43394 


“see equation (7.53) 


“see equation (7.55) 


The script file examp75.m simulates the Jury stability test undertaken in Example 7.5. 
With the controller gain K in Example 7.5 (Figure 7.14) set to 9.58 for marginal 
stability see equation (7.75), the roots of the denominator of the closed-loop pulse 
transfer function are calculated, and found to lie on the unit circle in the z-plane. 


Filename: examp75.m 


“Example 7.5 Stability in the z-plane 
Kk=9.58 

num=[XK]; 

den=conv([1 0],[1 2]); 

Ts=0.55 

[numa ,dend]=c2dm(num,den,Ts,'zoh'); 
[numc1d,denc1d]=cloo0p (numa, dend); 
printsys(numcld,dencld,*z') 
roots(dencld) 


Running examp75.m produces command window text 
y) 
K= 

9.5800 
num/den= 

0.88107z+0.63286 

z12-0.48681z+1.0007 

ans= 


0.24344+0.97031 “lies on unit circle ¡.e. vRP2+1P2=1 
0,2434-0.97031 %see equation (7.87) 
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Example 7.6 constructs the root-locus in the z-plane for the digital control system in 
Example 7.4 (Figure 7.14). 


Filename: examp76.m 


“Example 7.6 Root Locus Analysis in the z-plane 
num=[1]; 

den=conv([1 0],[1 2]); 

Ts=0.5; 

[numd ,dend]=c2dm(num,den,Ts,'zoh'); 
rlocus(numd,dend); 

axis('square') 

zgrid; 

k=rlocfind(numa,dend) 


Note that r1locus and rlocfind works for both continuous and discrete sys- 
tems. The statement * square” provides square axes and so provides a round unit 
circle. The command zgr id creates a unit circle together with contours of constant 
natural frequency and damping, within the unit circle. When examp76.m has been 
run, using rlocfind at the MATLAB prompt allows points on the loci to be 
selected and values of K identified (see Figure 7.20) 


»Select a point in the graphics window 
selected_point= 
0,2212+0.9591i 
k= 
9.7078 
»k=rlocfind(numd,dend) 
Select a point in the graphics window 
selected point= 
-2.0876-0.0117i 
k= 
60.2004 
k=rlocfind(numd,dend) 
Select a point in the graphics window 
selected_point= 
-1.0092-0.0117i 


k= 
103.3290 
Example 7.7 
A laser guided missile has dynamics 
20 
G(SH(s) = == 
(s)H(s) $645) 
and a compensator 
0.S(1+s 
Gas) = 


(1 +0.06255) 


Script file examp77.m plots the closed-loop step responses of both the continuous 
system and discrete system (see Figure 7.21). In the latter case the plant pulse transfer 
function uses zoh, and the compensator is converted into discrete form using 
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Tustin”s rule. Subplot (211) and (212) creates a 2 row, single column plot matrix (¡.e. 
produces 2 plots, one beneath the other). 


Filename: examp77.m 


“Example 7.7 Digital Compensator using Tustin's Rule 
“Laser Guided Missile 

num=[20]; 
den=conví[1 O 0],[1 5]); 
Ts=0.1; 
ncomp=0.8*[1 1]; 

dcomp=[0.0625 1]; 
[no1,do1]=series(ncomp,dcomp,num,den); 
[nc1,dc1]=clo0op(nol,dol1); 

[numa ,dend]=c2dm(num,den,Ts,'zoh'); 
[ncomd,dcoma]=c2dm(ncomp,dcomp, Ts, *tustin'); 
printsys(num,den,'s') 
printsys(numd,dend,*z”) 
printsys(íncomp,dcomp,*s') 
printsys(íncomd,dcomd,*z”) 
[nold,dold]=seriesí(ncomd,dcomd,numd,dend); 
[nc1ld,dcld]=cloop(nold,dolad); 

subplot(211), step(ncl,dcl); 

subplot (212), dstep(ncld,dcld); 


The open continuous transfer functions and pulse transfer functions for the plant and 
compensator are printed in the command window 


» 
num/den= 
20 
s1345512 
num/den= 
0.00295512"2+0.010482z2+0.002302 
z13-2.60652:2+2.21312-0.60653 
num/den= 
0.8s+0.8 
0.0625s+1 
num/den= 
7.4667z-6.7556 
z-0.11111 


“see equation (7.108) 


“see equation (7.110) 


Example 7.8 
Here pole placement is used to design a digital compensator that produces exactly the 
step response of the continuous system. 


Filename: examp78.m 


“Example 7.8 Digital Compensator Design using Pole Placement 
K=0.336 

numk=K* [3]; 

num=[3]; 
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den=conv([1 0]1,[1 1]); 

Ts=0.5; 

[nc1,dc1]=cl1o00p(numk, den); 
ncomd=0.327*[1-0.6065]; 

dcomd=[ 1-0.519]; 

[numd ,dend]=c2dm(num,den,Ts,'zoh'); 
[nol1d,do1d]=seriesí(ncomd,dcomd,numd,dend); 
[nc1d,dclad]=cloop(nold,dold); 
printsys(num,den,*s') 
printsys(numd,dend,*z') 
printsysíncomd,dcomd,*z”) 
printsys(ncl,dcl1,'s') 
printsysíncld,dcld,*z”) 
subplot(211), step(ncl,dc1); 
subplot (212), dstep(ncld,dcld); 


The continuous and discrete closed-loop systems are shown in Figures 7.22(a) and 
(b). The digital compensator is given in equation (7.128). Script file examp78.m 
produces the step response of both systems (Figure 7.25) and prints the open and 
closed-loop continuous and pulse transfer functions in the command window 


» 
K= 
0.3360 

num/den= 

3 

s12+s 

num/den= 

0.319592+0.27061 

z12-1.6065z+0.60653 

num/den= 

0.327z-0.19833 

z-0.519 

num/den= 

1.008 

s:24+s+1.008 

num/den= 
0.104512*24+0.025107z-0.053669 

z13-2.0212:2+1.4654z-0.36846 


“see equation (7.115) 


“see equation (7.128) 


A1.8 Tutorial 7: State-space methods for control system 
design 


This tutorial looks at how MATLAB commands are used to convert transfer func- 
tions into state-space vector matrix representation, and back again. The discrete-time 
response of a multivariable system is undertaken. Also the controllability and obser- 
vability of multivariable systems is considered, together with pole placement design 
techniques for both controllers and observers. The problems in Chapter 8 are used as 
design examples. 
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Example 8.4 

This converts a transfer function into its state-space representation using 
tf2ss(num, den) and back again using ss2tf (A,B,C,D,iu) when ju 
is the ith input u, normally 1. 


Filename: examp84.m 


Example 8.4 transfer function to state space representation 
“And back again 

num=[4]; 

den=[13621; 

printsys(num,den,'s') 

[A,B,C,D]=tf2ss(num,den) 

[numl ,den1]=ss2tf(A,B,C,D,1); 

printsys(numl,denl,*s') 

condition_number=cond(A) 


The print-out in the command window is 


»examp84 
num/den=. 
4 
s134+358:2465+2 
A= 
-3 6 -2 
1.0 0 
0 E 0 
B= 
1 
0 
0 
C= 
0 0 4 
D= 
0 
num/den= 
4.441e-0165'2+5.329e-0155+4 
s13435124+658+2 


condition_number= 
24.9599 


Comparing the output with equation (8.35) 1t will be noticed that the top and bottom 
rows of A have been swapped, which means that the state variables x¡ and x3 have 
also been exchanged. This means that if the user is expecting the state variables to 
represent particular parameters (say position, velocity and acceleration), then the 
rows of A and B, and the columns of C might have to be re-arranged. 

The conversion from state-space to transfer function has produced some small 
erroneous numerator terms, which can be neglected. These errors relate to the 
condition of A, and will increase as the condition number increases. 

Example 8.8 uses c2d to calculate the discrete-time state and control transition 
matrices A(T') and B(T') as given by equations (8.78), (8.80), (8.82) and (8.85). The 
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matrix-vector difference equation (8.76) is then used to calculate the first five discrete 
values of the state variables when responding to a unit step input. 


Filename: examp88.m 


%Calculate state and control transition matrices 
A=[0 1;-2 -3] 

B=[0;1] 

Ts=0.1 

[AT,BT]=c2d(A,B,Ts) 

“Compute discrete step response 

kT=0 

x=[0;0] 

u=1 

tor i=1:5 

xnew=AT*x+BT*u; “*Matrix-vector difference equation (8.76) 
kT=kT+4+TsS 

x=xnew 

end 


The command window text is 


» examp88 
Os Fil 
-2 -3 
B= 
0) 
1 
Ts= 
0.1000 
AT= 


0.9909 0.0861 
-0.1722 0.7326 


BT= 
0.0045 
0.0861 

kT= 
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kT= 
0.3000 
x= 
0.0336 
0.1920 
kT= 
0.4000 
x= 
0.0543 
0.2210 
kT= 
0.5000 
x= 
0.0774 
0.2387 


» 


The for-end loop in examp88.m that employs equation (8.76), while appearing very 
simple, is in fact very powerful since 1t can be used to simulate the time response of any 
size of multivariable system to any number and manner of inputs. IFA and B are time- 
varying, then A(T') and B(T') should be calculated each time around the loop. The 
author has used this technique to simulate the time response of a 14 state-variable, 6 
input time-varying system. Example 8.10shows the easein which the controllability and 
observability matrices M and N can be calculated using ctrb and obsvand their rank 


checked. 


Filename: examp810.m 
“Example 8.10 


“Controllability and observability 


A=[-2 0;3 -5] 


B=[1;0] 
Cc=[ 1 1] 
D=[0] 


M=ctrb(A,B) 

rank_of M=rank(M) 
system_order=length(A) 
N=(obsv(A,C))” 
Rank_of_N=rank (N) 


The command window will display 


»examp810 
A= 
2 0 
3 -5 
B= 
1 
0 
C= 
1 -1 
D= 
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M= 


1 -2 
0 3 
rank_of_M= 
2 
system_order= 
2 “rank of M=systemorder. System completely 
*“controllable. 
N= 
1 -5 
-1 5 
rank_of_N= 
1 “rank of N< system order. System isunobservable. 


Example 8.11 uses Ackermann's formula (acker) to calculate the elements of a 
regulator feedback matrix K, that places the closed-loop poles at some desired 
location in the s-plane. 


Filename: examp811.m 


“Example 8.11 

“Regulator design using pole placement 
$G(s)=1/s(s+4) 

num=1; 

den=conv([1 0]1,[1 4]); 
printsys(num,den,*s”) 

$convert to state space 
[A,B,C,D]=tf2ss(num,den); 

“Check for controllability; 
rank_of_M=rank(ctrb(A,B)) 
system_order=1length(A) 

“Enter desired characteristic equation 
charegn=[1 4 4] 

“Calculate desired closed-loop poles 
desiredpoles=roots(chareqn) 
“Calculate feedback gain matrix using Ackermann's formula 
K=acker(A,B,desiredpoles) 
*Closed-loop state feedback system 
Asf=A-B*K;Bsf=B;Csf=C;Dsf=0; 

[numsf ,densf]=ss2tf (Asf,Bsf,Csf,Dsf); 
densf 

roots(densf) 


In examp811.m, the closed-loop transfer function is obtained and the roots of the 
denominator calculated to check that the closed-loop poles are at the desired loca- 
tions. The output at the command window is 


»examp811 
num/den= 
1 
s1244s 
rank_of_M= 
2 
system_order(=) % Rank of M = system order hence system 
2 % is controllable 
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charegqn= 
144 
desiredpoles= 
-2 


-2 % Actual closed-loop poles = desired closed-loop poles 


Example 8.12 shows how acker uses the transpose of the A and C matrices to 
design a full-order state observer. 


Filename: examp812.m 


“Example 8.12 
+Full-order observer design using pole placement 
A=[0 1;-2 -3] 


B=[0;1] 
C=[4: “07 
D=[0] 


+Check for observability; 

N=obsv(A,C) 

rank_or_N=rank(N) 

system_order=1length(A) 

Enter desired characteristic equation 

charegn=[1 10 100] 

“Calculate desired observer eigenvalues 
desiredeigenvalues=roots(chareqn) 

“Calculate observer gain matrix using Ackermann's formula 
Ke=acker(A',C” desired_eigenvalues) 


The command window text is 


»examp812 
A= 
o 1 
-2 -2 
B= 
0 
1 
C= 
1.0 
D= 
0 
N= 
1.0 
o 1 
rank_of_N= 
2 
system_order= 
2 % Rank of N = system order hence system 


% is observable 
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charegqn= 
1 10 100 
desired_eigenvalues= 
-5.0000+8.66031 
-5.0000-8.66031 
Ke= 
7.0000 77.0000 % Agrees with equation (8.150) 


Example 8.13 illustrates the design of a regulator combined with a reduced-order 
state observer. 


Filename: examp813.m 


“Example 8.13 

“Regulator and reduced-order observer design 
“Using pole placement 

$G(s)=1/s(s+2)(s+5) 

“Input in state-space format directly 

A=[0. 10:30 0 1;0: =10: =7'] 


B=[0;0;1] 
Cc=[1 O 0] 
D=[0] 


“Regulator design 

“Check for controllability; 
rank_of_M=rank(ctrb(A,B)) 

“Enter desired characteristic equation 

charegn=[1 7 25 15] 

“Calculate desired closed-loop poles 
desiredpoles=roots(charegn); 

%Calculate feedback gain matrix using Ackermann's formula 
K=acker(A,B,desiredpoles) 

Reduced-order observer design 

1E=[1 0] 

EE=[0 1;-10 -7] % See equation (8.163) 
obcharegn=[ 1 63.2 2039.4] 
observerpoles=roots(obcharegn); 

“Calculate observer matrix using Ackermann's formula 
Ke=acker(AEE', A1E”, observerpoles) 


OS 


Note that the transposes of the partitioned matrices Aj. and Aj. from equation 
(8.163) are used in acker to calculate K. for the reduced-order state observer. 
The command window output is 


»examp813 
A= 

0 1.0 

0 o 1 

o -10 -7 
B= 

0 

(0) 

dl 
C= 

El 0.0 
D= 


408 Advanced Control Engineering 


charegqn= 
1- 72515 
K= 
15.0000 15.0000 0 % Regulator feedback matrix 
ALE= 
1.0 
AEE= 
o 1 
-10 -7 
obchareqn= 
1.0e4+003+ 
0.0010 0.0632 2.0394 
Ke= 
1.0e4+003* 
0.0562 1.6360 “Reduced-order observer matrix 


A1.9 Tutorial 8: Optimal and robust control system 
design 


This tutorial uses the MATLAB Control System Toolbox for linear quadratic 
regulator, linear quadratic estimator (Kalman filter) and linear quadratic Gaussian 
control system design. The tutorial also employs the Robust Control Toolbox for 
multivariable robust control system design. Problems in Chapter 9 are used as design 
examples. 


Example 9.1 
This example uses the MATLAB command 1q1 to provide the continuous solution 
of the reduced matrix Riccati equation (9.25) 


Filename: examp91.m 


“Example 9.1 
“Continuous Optimal Linear Quadratic Regulator (LOR) Design 


A=[0 1;-1 -2] 
B=[0;1] 

Q=[2 0;0 1] 

R=[1] 
[K,P,El=1gr(A,B,Q,R) 


The output at the command window is 


»examp91 
A= 

A 
-1 -2 
B= 

0 


1 
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Q= 

2.0 E : . A j 

o 1 $State weighting matrix, see equation (9.8) 
R= 

1 “Control weighting matrix, see equation (9.8) 
K= 

0.7321 0.5425 “State Feedback gain matrix, see equations 

(9.20) and (9.46) 

P= 

2.4037 0.7321 E : . , 

07321 05425 $Riccati matrix, see equation (9.45) 
--1.27124+0.34061 +Closed-1loop eigenvalues 
-1.2712-0.3406i 
Example 9.2 


This example solves the discrete Riccati equation using a reverse-time recursive 
process, commencing with P(n)=0. Also tackled is the discrete state-tracking 
problem which solves an additional set of reverse-time state tracking equations 


(9.49) to generate a command vector v. 


Filename: examp92.m 


Example 9.2 

iscrete Solution of Riccati Equation 
ptimal Tracking Control Problem 

[O 1;-1 -1];5 

051]; 

10 0;0 1]; 

11; 

0.9859 -0.27;0.08808 0.76677]; 
-0.9952 0.01409;-0.04598 -0.088081; 
0;0]; *Initialize 


ILIDou 


Os. .. 


¿Ls 
,BD]=c2d(A,B,Ts); 
0050. 0171; 
H=BD'*P; 
X=Ts*R4+H*BD; 

Y=H*AD; 

K=XY ; 


YUZ4<H3HONO idea > 0 e ye 


lao 11 
=0|l DO => 


“Discrete reverse-time solution of the Riccati equations (9.29) 


“and (9.30) 


“Discrete reverse-time solution of the state tracking equations 


%(9.53) and (9.54) 
for i=1:200 
L=Ts*Q+K'*Ts*R*K; 
M=AD-BD*K; 


PP1=L4M'*P*M; +*Value of Riccati matrix at time (N-(k+1))T 


RIN=[-sin(0.6284*T);0.6*cos(0.6284*T)]1; 
SP1=F*S4+G*RIN; 


V=-B'*SsP1; +*Value of command vector at time (N-(k+1))T 


s=SP1; 
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T=T+Ts; 

P=PP1; 

H=BD'xP; 

X=Ts*R+H*BD; 

Y=H*AD; 

K=XXY; “Value of feedback gain matrix at time 
% (N- (k4+1))T 

end 


Checking values in the command window gives 


»examp92 
»A 
A= 
o 1 
-1 -1 
»B 
0 
1 
»O 
e a “State weighting matrix 
»R 
1 “Control weighting matrix 
» Ts 
Ts= 
0.1000 
» AD 
AD= 


0.9952 0.0950 


-00950 0.9002 +Discrete-time state transition matrix 


0.0048 *Discrete-time control transition matrix 


2.0658 1.4880 “Discrete-time steady-state feedback gain 
% matrix, after 200 reverse-time iterations 


8.0518 2.3145 “Steady-state value of Riccati matrix 
2.3145 1.6310 


The reverse-time process is shown in Figure 9.3. The discrete-time steady-state feed- 
back matrix could also have been found using 1qrad, but this would not have 
generated the command vector v. The forward-time tracking process is shown in 
Figure 9.4 using K(kT) and v(kT') to generate up (kT) in equation (9.55). The script 
file kalfilc.m uses the MATLAB command l1qe to solve the continuous linear 
quadratic estimator, or Kalman filter problem. 


Appendix 1 Control system design using MATLAB 411 


Filename: kalfilc.m 


“Continuous Linear Quadratic Estimator (Kalman Filter) 


A=[0 1;-1 -2] 

B=[0;1] 

C=[1 0;0 1] 

D=[0] 

R=[.0.01 :0:p.0: 1] 

Cd=[0.1 0;0 0.01] 
o=[0.1 0;0 0.1] 
[K,P,El=1qe(A,Cd,C,Q,R) 


The command window text is 


»kalfilc 
A= 
o 1 
= 12 
B= 
0) 
1 
E= 
1 0 
o 1 
D= 
0) 
R= 
0.0100 0 %Measurement noise covariance matrix 
0 1.0000 
Cd= 
0.1000 0 *Disturbance matrix 
0 0.0100 
Q= 
0.1000 0 *Disturbance noise covariance matrix 
0 0.1000 
K= 
0.1136 -0.0004 “Kalman gain matrix 
0.0435 0.0002 
P= 
0.0011 -0.0004 *Estimation error covariance matrix 
0.0004 0.0002 
E= 


_-10569+0.25891 “Closed-loop estimator eigenvalues 


-1.0569-0.25891 


The script file ka/fild.m solves, in forward-time, the discrete solution of the Kalman 
filter equations, using equations (9.74), (9.75) and (9.76) in a recursive process. The 
MATLAB command 1qed gives the same result. 


Filename: kalfild.m 


“Discrete Linear Quadratic Estimator (Kalman Filter) 
“The algorithm uses discrete transition matrices A(T) and Cd(T) 
A=[0 1;-2 -3] 
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Cd=[0.1 0;0 0.1] 

C=[1 0;0 1] 

ID=eye(2); 

Ts=0.1 

[AT,CD]=c24(A,Cd,Ts) 

R=[0.01 0;0 1.0] 

o=[0.1 0;0 01] 

“Discrete solution of Kalman filter equations 
“Initialize 

P1=1D; “Initial covariance matrix=identity matrix 
P2=(AT*P1*AT')+(CD*Q*CD'); 

X=P2*C'"; 

Y=(C*P2*C'")+R; 

K=X/Y; 

P3=(ID-(K*C))*P2; 

“Solve recursive equations 


for i=1:20 

P1=P3; 
P2=(AT*P1*AT')+(CD*Q*CD'); 
X=P2*C'"; 

Y=(C*P2*C')+R; 

K=X/Y; 

P3=(ID-(K*C))*P2; 

end 


Checking results in the command window 


»kalfild 
o 1 
E 
Ed= 
0.1000 0 *Disturbance matrix 
O 0.1000 
C= 
1 0 
0 1 
Ts= 
0.1000 
AT= 
0.9909 0.0861 *$Discrete-time state transition matrix 
-0.1722 0.7326 
CD= 
0.0100 0.0005 *Discrete-time disturbance transition 
-0.0009 0.0086 “matrix 
R= 
0.0100 0 %Measurement noise covariance matrix 
oO 1.0000 
0.1000 0 *Disturbance noise covariance matrix 
O 0.1000 
» K 


0.0260 -0.0002 %Kalman gain matrix after 21 iterations 
-0.0181 0.0002 
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Example 9.3 

This is a china clay band drying oven. The state and output variables are burner 
temperature, dryer temperature and clay moisture content. The control parameters 
are burner gas supply valve angle and clay feed-rate. A linear quadratic Gaussian 
control strategy is to be implemented. Script file examp93.m calculates the optimal 
feedback control matrix K and also the Kalman gain matrix K. using the recursive 
equation (9.99). 


Filename: examp93.m 


“Linear Quadratic Gaussian (LOG) Design 
“Case Study Example 9.3 Clay Drying Oven 
“Optimal Controller 
A=[-0.02128 O 0;0.0006 -0.005 0;0 -0.00038 -0.00227] 
B=[8.93617;0;0] 
Ca=[0.1 0 0;0 0.1 0;0 O 0.00132] 
=[1 0 0;0 1 0;0 O 1] 
=[0] 


[AT, BT] =c2d(A,B, Ts) 
0=[0 0 0;0 0.5 0O;0 O 20] 


[K,P,E]=1gr(A,B,Q,R) 

+$Kalman Filter 

Re=[0.01 0 0;0 0.01 0;0 O 7.46] 

Qe=[01 0 0;0 01 0;0 O 0.1] 
[AT,CD]=c24(A,Cd,Ts) 

$Initialize 

“Implement equations (9.99) 

ID=eye (3); 

P1=ID; $Initial covariance matrix=identity matrix 
P2=(AT*P1*AT')+(CD*Qe*CD'); 


X=P2*C"; 
Y=(C*P2*C')+Re; 
Ke=X/Y; 


P3=(ID-(Ke*C))*P2; 

“Solve recursive equations 
for i=1:19 

P1=P3; 
P2=(AT*P1*AT")+(CD*Qe*CD'); 
X=P2*C"'; 

Y=(C*P2*C')+Re; 

Ke=X/Y; 
P3=(ID-(Ke*C))*P2; 

End 

Ke 

P3 


The output at the command window is 


» examp93 
A= 
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-0.0213 0 0 
0.0006 -0.0050 0 
B= O -0.0004 -0.0023 
8.9362 
0 
0 
Cd= 
0.1000 0 0 
O 0.1000 0 
0 O 0.0013 
C= 
L.-:0: 0 
0-10 
0000. 
D= 
0 
AT= 
0.9583 0 0 
0.0012 0.9900 0 
0.0000 -0.0008 0.9955 
BT= 
17.4974 
0.0105 
0.0000 
Q= 
0 0 0 
0 0.5000 0 
0 O 20.0000 
R= 
L 
K= 
0.0072 0.6442 -1.8265 
P= 
1.0e4+003* 
0.0000 0.0001 -0.0002 
0.0001 0.0108 -0.0300 
0.0002 -0.0300 3.6704 
E= 
-0.0449+0.04221 
-0.0449-0.0422i 
0.0033 
Re= 
0.0100 0 0 
O 0.0100 0 
0 0 7.4600 
Qe= 0.1000 0 0 
O 0.1000 0 
0 0 0.1000 
ED= 
0.1958 0 0 
0.0001 0.1990 0 


Disturbance matrix, equation 


SA(T), Ts=2 seconds 


<B(T), equation (9.86) 


“State weighting matrix 


“Control weighting matrix 


“Feedback gain matrix, 
“equation (9.92) 


“Riccatimatrix, equation 
% (9.91) 


%Closed-loop eigenvalues, 
“equation (9.93) 


%Measurement noise covariance 
“matrix, equation (9.100) 


*Disturbance noise covariance 
“matrix, equation(9.101) 


Discrete-time disturbance 
“transition matrix, equation 
(9.95) 
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0.0000 -0.0001 0.0026 


Ke= 
0.4408 0.0003 0.0000  %Kalman gain matrix after 20 
Siterations, 
0.0003 0.4579 0.0000  %equation (9.102) 
0.0000 -0.0006 0.0325 % and Figure 9.16 
P3= 


0.0044 0.0000 0.0000 +SEstimation error covariance 
*$matrix, 

0.0000 0.0046 0.0000 +after 20 iterations, 

0.0000 0.0000 0.2426 “equation (9.102) 


The implementation of the LOG design is shown in Figures 9.12 through to 9.17. 


Example 9.6 

This is a multivariable robust control problem that calculates the optimal Ha, 
controller. The MATLAB command hinfopt undertakes a number of iterations 
by varying a parameter y until a best solution, within a given tolerance, is achieved. 


Filename: examp96.m 


“Example 9.6 

“Multivariable robust control using H infinity 
“Singular value loop shaping using the weighted mixed 
“sensitivity approach 

nug=200; 

dng=[1 3 102 200]; 
lag,bg,cg,dgl=tf2ss(nug,dng); 
ss_g=mksys(ag,bg,cg,dag); 

wl=[1 100;100 11; 

nwlneg=[100 1]; 

dwineg=[1 100]; 

w2=[1;1]; 

w3=[100 1;1 100]; 

nw3neg=[1 100]; 

dw3neg=[100 1]; 

[TssS_1]=augtf (ss_g,wl,w2,w3); 

[ap ,bp,cp,dp]l=branch(TSS_); 
[gamopt,ss_f,ss_c1]=hinfopt(TSS_,1); 
lacp,bcp,ccp,dcp]=branch(ss_f); 
lac1,bc1,ccl,dcl]=branch(ss_cl); 
[numcp,dencp]l=ss2tf (acp,bcp,ccp,dcp, 1); 
printsys(nug,dng,*s') 
printsys(nwlneg,dwlneg,*s') 
printsys(nw3neg,dw3neg,*s') 
w=logspace(-3,3,200); 
%[mag,phase,w]=bode(nwlneg,dwlneg,w); 
%[magl,phasel,wl=bode (nw3neg,dw3neg,w); 
“semilogx(w,20*10g10 (mag) ,w,20*1o0g10(magl1)) grid; 
[sv,w]=sigma(ss_9g); 
%[sv,wl=sigma(ss_c1); 
%[sv,wl=sigma(ss_f); 
semilogx(w,20*log10(sv)) grid; 

ag 

bg 
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ccp 
dcp 
printsys(numcp,dencp,'*s”') 


The command mksys packs the plant state-space matrices ag, bg, cg and dg into a 
tree structure ss_g. 

The command augtf augments the plant with the weighting functions as shown 
in Figure 9.31. The branch command recovers the matrices ap, bp, cp and dp 
packed in TSS_. The hinfopt command produces the following output in the 
command window 


No Gamma D11<=1 P-Exist P>=0 S-Exist s>0 lam(PS)<1 C.L. 


1  1.0000e+000 OK OK FAIL OK OK OK UNST 
2  5.0000e-001 OK OK FAIL OK OK OK UNST 
3 2.5000e-001 OK OK FAIL OK OK OK UNST 
4  1.2500e-001 OK OK OK OK OK OK STAB 
5  1.8750e-001 OK OK FAIL OK OK OK UNST 
6  1.5625e-001 OK OK FAIL OK OK OK UNST 
7  1.4063e-001 OK OK FAIL OK OK OK UNST 
ge  1.3281e-001 OK OK FAIL OK OK OK UNST 
9 1.2891le-001 OK OK OK OK OK OK STAB 
10 1.3086e-001 OK OK FAIL OK OK OK UNST 
11 1.2988e-001 OK OK OK OK OK OK STAB 


Iterationno. 11 is your best answer under the tolerance: 0.0100. 


After eleven iterations, hinf opt identifies that y in equation (9.176) has a best 
value of 0.13. The command sigma calculates the data for a singular value Bode 
diagram as shown in Figures 9.32, 9.34 and 9.35. Other information printed in the 
command window is given below 


num/den= 
200 


$3+382+1028+200 Plant transfer function 


num/den= 

100s+1 

s+100 

num/den= 

s+100 

100s+1 

ag= 

-3 -102 -200 

all 0 0 
0 1 0 
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bg= 
1 
0 
0 
cg= 
o 0 200 
dg= 
0 
acp= 
0.0100 -0.0022 0.0039 0.0148 0.1367 “Controller 
*matrices, 
0.0086 -7.7634 21.6533 37.1636 621.8932 “See equation 
$(9.178) 
0.0461 -2.0317 -3.1477 -2.2338 -81.8751 
0.4353 0.1067 8.8071 -102.2531  -37.7767 
Bop 0.6756 0.1970 13.55575 -3.7282 -162.5129 
7.9756 
0.0906 
0.5820 
-8.8009 
-13.6595 
ccp= 
-0.0861 0.1698 0.1213 0.6544  -11.1708 
dcp= 
0 
num/den= 


159.1184544+16389.19055"34+63965.5785s5"2+1654830.8855s+3182367.0874 
s154+275.687544+20439.81415:3+324835.01985:24+3782679.13935+37794.3283 


“Controller transfer function, 
“See equation (9.179) 


A1.10 Tutorial 9: Intelligent control system design 


This tutorial uses the MATLAB Control System Toolbox, the Fuzzy Logic Toolbox 
and the Neural Network Toolbox. Problems in Chapter 10 are used as design examples. 


Example 10.3 

This is the inverted pendulum control problem and, as a benchmark, is initially 
solved as a multivariable control problem, using pole placement (Ackermann's 
formula) to calculate the feedback gain matrix in exampl103.m. 


Filename: examp103m 


“Regulator design using pole placement 
“Inverted pendulum problem 

A=[0 1 0 0;981 0 0 050 0 0 1;-327 0 0 O] 
B=[0;-0.667;0;0.889] 

c=[1 0 0 0] 

D=0 

“Check for controllability; 
rank_of_M=rank(ctrb(A,B)) 
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+Enter desired characteristic equation 

charegn=[1 12 72 192 256] 

“Calculate desired closed-loop poles 
desiredpoles=roots(chareqn) 

“Calculate feedback gain matrix using Ackermann's formula 
K=acker(A,B,desiredpoles) 


The output at the command window is 
»examp103 


di O 1.0000 
9.8100 0 
0 0 
-3.2700 0 
B= 
0 
-0.6670 
0 
0.8890 


1.0000 


¡cjojoje, 


rank_of_M= 
4 
charegn= 
1:12 72 192 256 
desiredpoles= 
-4.0000+4.00001 
-4.0000-4.00001 
-2.00004+2.00001 
-2.0000-2.00001 


K= 
-174.8258 -57.1201 -39.1437 -29.3578 


The state-variable feedback solution was implemented in SIMULINK as shown in 
Figure A1.4, 

Inverted Pendulum, Fuzzy Logic Controller Design: The fuzzy logic controller used 
for the inverted pendulum problem has four input windows and one output window 
as shown in Figure 10.14. One version of the controller has a Mamdani-type rulebase 
consisting of 11 rules as given in equation (10.52). The MATLAB Fuzzy Inference 
System (FIS) Editor can be entered by typing at the MATLAB prompt 


» Fuzzy 


This brings up the main menu screen as shown in Figure A1.5. Double-clicking on 
the “theta” icon brings up the membership function editor. Figure A1.6 shows the NB 
fuzzy set being given the trapizoidal (trapmf) membership function [—1 —1 —0.10)]. 
Other membership functions include gaussmf (Gaussian), trimf (triangular) and 
gbellmf (generalized bell). For further information type 


» help fuzzy 


Returning to the main menu and double-clicking on the centre box entitled 
“Pendulum 11” (mamdani) will bring up the FIS rule editor, as shown in Figure 
A1.7. Highlighted are the antecedents and the consequent of Rule 1. 
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theta 


174 


tdot 


Tas 


> + 
¡E Lg y X= Ax+Bu 
d y = Cx+Du Scope1 
> + Inverted pendulum 
Xx .—>»| 
Las Scope2 
> >» 
xdot 
S 4 
cope Scope3 
Fig. A1.4 Inverted pendulum control system design using pole placement 
theta 
ESA Pendulum11 
tdot 
Ñ 3 a rn (mamadani) 
x 
ya 
xdot 
FIS Name: Pendulum11 FIS Type: mamdani 
And method min y Current Variable 
Name 
Or method max Y 
pits j Type 
Implication min v 
Range 
Aggregation max y 
PUEZINSAon centroid dd Help Close 
System "Pendulum11”: 4 inputs, 1 output, and 11 rules 


Fig. A1.5 Main menu of Fuzzy Inference System (FIS) editor. 


Membership function plots plot points: 


181 


FIS Variables NB 


0.5 


Z 


PB 


0.08 0.02 0 0.02 


0.04 0.06 
Input variable “theta” 


0.08 


0.1 


theta 


input 
Range 


Display Range 


Current Membership Function (click on MF to select) 


Name 
NB 


Type 


trapmf 


Params 


[Ef sti =0:1 0] 


[20.1 0.1] 


[-0.1 0.1] Help 


Close 


Ready 


Fig. A1.6 FIS membership function editor. 
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(theta is PB) and (tdot is PB) then (fis PB) 
2. If (theta is PB) and (tdot is Z) then (fis PB) (1 
3. If (theta is PB) and (tdot is NB) then (fis Z) (1 
4. If (theta is Z) and (tdot is PB) then (fis PB) (1 
5. If (theta is Z) and (tdot is Z) then (fis Z) (1) 
6 
7. 
8 
9 


nl 1) 


lj 
AM 
M 
f 


theta is NB) and (tdot is PB) then (fis Z) (1 
theta is NB 
. If (theta is NB 
10. If (tdot is PB, 
11. If (tdot is NB 


If ( 

. If (theta is Z) and (tdot is NB) then (fis NB) (1 
If ( 
If ( 


) 

) 
and (tdot is Z) then (fis NB) (1) 
and (tdot is NB) then (fis NB) (1) 
then (fis PB) (1) 
then (fis NB) (1) 


If and and and Then 
theta is tdot is x is xdot is fis 
NB NB NB NB NB 
Z Z Z Z Z 
PB PB 
none none nene 
not not not not not 

—Comnectiony Weight 

O or 

e and 1 Delete rule || Add rule || Change rule CIL] 


FIS Name: Pendulum1 1 Help 


Close 


Fig. A1.7 FIS rule editor. 


Ss » 
force 
theta 
x' = Ax+Bu A 
Inverted pendulum 
Fuzzy Logic 
Controller »| 
XxX 
xdot 


Fig. A1.8 Simulink implementation of inverted pendulum fuzzy logic control problem. 
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When editing is complete, the controller is stored as a .fis file, in this case 
pendulumll.fis. The inverted pendulum fuzzy logic control problem can now be 
implemented in SIMULINK as shown in Figure A1.8. The fuzzy logic icon is 
obtained by opening the fuzzy logic toolbox within the Simulink Library Browser, 
and dragging it across. Running the simulation as 1t stands in Figure A1.8 will bring 
up a MATLAB error because the properties of the fuzzy logic controller have not 
been defined. At the MATLAB prompt, type 


» fismat=readfis 


This will allow you to select from a directory a suitable stored filename, 1.e. 
penduluml 1.fis. The system will respond with 


fismat= 

name: “Penduluml11' 
type: “mamdani” 
andMethod: “min” 
orMethod: “max” 
defuzzMethod: *centroid' 
impMethod: “min” 
aggMethod: “max” 

input: [1x4 struct] 
output: [1x1 struct] 
rule: [1x11 struct] 


This means that the fuzzy logic controller parameters have been placed in the work- 
space under *f ismat ”, and that the simulation can now proceed. More details on 
the properties of the fuzzy logic controller can be found by typing 


» out=getfis[(fismat) 
The system will respond with 


Name =Penduluml11l 
Type =mamdani 
NumInputs=4 
InLabels= 

theta 

tdot 

Xx 

xdot 
Num0utputs=1 
OutLabels= 

f 
NumRules =.1111 
AndMethod =min 
OrMethod =max 
ImpMethod =min 
AggMethod =max 
DefuzzMethod =centroid 
Out= 
Pendulum 11 


The results of the pole placement and the 11 rule and 22 rule fuzzy logic controllers 
are compared in Figure 10.15. Figure 10.16 shows the 0—0 control surface, also 
generated using the FIS Editor. 
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1 neuron 
output layer 
purelin activation function 


1 neuron 
input layer 


10 neuron 
hidden layer 
tansig activation function 


Fig. A1.9 Demonstration neural network. 


The MATLAB Neural Network Toolbox: This Toolbox was not used in the Exam- 
ples given in Chapter 10. For details on the Toolbox, type 


» help nnet 


To demonstrate how the Toolbox is used, consider a neural network with a structure 
shown in Figure A1.9. 
The script file neural1.m trains and runs the network. 


Filename: neurall.m 


“Feedforward Back-propagation Neural Network 
“Network structure: 1:10(tansig):1(purelin) 
*P=Input values 

P=[0 1234 55067 U8l; 

%T=Target values 

T=[0 084 0.91 0.14 -0.77 -0.96 -0.28 0.66 0.99]; 
plot(P,T,*0'); 

“Use Levenberg-Marquardt back-propagation training 
net=newff([0 8]1,[10 1],(*tansig''*purelin'), “trainlm'); 
Yl=sim(net,P); 

plotiP:, TP, YL, to"); 

net.trainParam.eepochs=50; 

net=trainí(net,P,T); 

Y2=sim(net,P); 

plot(P:,T,P,Y2,%0)3 


P is a vector of inputs and T a vector of target (desired) values. The command 
newff creates the feed-forward network, defines the activation functions and the 
training method. The default is Levenberg-Marquardt back-propagation training 
since it is fast, but it does require a lot of memory. The train command trains the 
network, and in this case, the network is trained for 50 epochs. The results before and 
after training are plotted. 


Appendix 2 
Matrix algebra 


A2.1 Definitions 


Matrix: An m x n matrix A is an array of elements with m rows and n columns, and 
is written as 


a11 a1 E Un 


d1 429 ... 0 
A=| 2“ (A2.1) 


Ami Am --.  Úmn 


If m=n, A is a square matrix. 


Vector: A column vector x is 
x=|. (A2.2) 


A row vector y 1s 


y =[)y1 y2-.. yl (A2.3) 


Null matrix: This has all elements equal to zero. 


Ne 
A 

a (A2.4) 
0.0...0 


Diagonal matrix: This is a square matrix with all elements off the diagonal equal to 
Zero. 


C11 0 0 
C= 0 C22 0 (A2.5) 
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Identity matrix: This is a diagonal matrix with all diagonal elements equal to unity, 
and is normally denoted by I. 


1.0.0 
I=|0 1 0 (A2.6) 
0.0 1 
Symmetric matrix: This is a square matrix where elements aj; = ay. 
5.859 
S=|8 4 2 (A2.7) 
923 


A2.2 Matrix operations 


Transpose of a matrix: The transpose of a matrix A, denoted by A*, is formed by 
interchanging its rows and columns. 


2.45 
A=|3 1 9 (A2.8) 
6 8 4 
2.356 
AT=|4 1 8 (A2.9) 
594 
Determinant of a matrix: Given a 2 x 2 matrix 
A= Pa e] (A2.10) 
da 42 
Its determinant is 
detA = St Aia = 41142 — 0421412 (A2.11) 
di 42 


Minors of an Element: The minor My of element aj; of detA is the determinant 
formed by removing the ¡th row and the ¡th column from det A. 


8 6 2 
detA=|4 3 1 
9 5 7 
6. 
Ma =|5 ¿| =-14 (42.12) 


Cofactor of an Element: The cofactor C;¡¡ of element aj; of det A is defined as 


OC, = EDOPM;, 
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In general, the determinant of a square matrix is given by 
detA = y ax C ix (expanding along the ¡th row) 
k=1 


or 
m 


detA = y ax¡Crj (expanding along the ¡th column) (A2.13) 
k=1 


Given 


Expanding along the first column gives 


30 4 5 4 5 
detA =2 4 +6 
8 9 8 9 30 
= 227) - 1-4) + 6-15) 
=-32 (A2.14) 


Singular matrix: A matrix is singular if its determinant is zero. 
Nonsingular matrix: A matrix is nonsingular if its determinant is not zero. 


Adjoint of a matrix: The adjoint of an n x n matrix is the transpose of the matrix 
when all elements have been replaced by their cofactors. 


Ce Bra 
adj A = E 5 o be (A2.15) 
6 a ud 
Inverse of a matrix: An nx n matrix A has an inverse A7!, which satisfies the 
relationship 
ATIA=AA"!=I1 (A2.16) 
The inverse of A is given by 
E da (A2.17) 
Addition and subtraction of matrices: The sum of two matrices 
A+B=C 
is given by 
aj + bj = Cy (A2.18) 


the difference between two matrices 


A-B=C 
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is given by 
dj — Dj = Cy (A2.19) 
Multiplication of matrices: The product of two matrices 
AB=C 
is given by 
Ci = E aiDri (A2.20) 


k= 


a a 
A.= 1 12 
(05) 022 


SS ka; ka 
kA = | a el (A2.21) 


Multiplication by a constant 


Note that in general, multiplication is not commutative, 1.e. AB X BA. 


Trace of a matrix: The trace of an n x n matrix is the sum of the diagonal elements of 
the matrix. 


trA = 411 +42 +::* + Am (42.22) 


Rank of a matrix: The rank of a matrix is equal to the number of linearly independ- 
ent rows or columns. The rank can be found by determining the largest square 
submatrix that is nonsingular. 


If 
1.2 3 
A=|0 4 1 (A2.23) 
1.2 3 
since det A is zero, the 3 x 3 matrix is singular. Consider a submatrix 
1 2 
Ásub = la A (A2.24) 


The determinant of Ayup is 4, hence the rank of A is the size of Ayub, 1.0. 2. 
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